Sep 30 10:18:00 devstack cinder-volume[76059]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 30 10:18:00 devstack cinder-volume[76059]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 10:18:00 devstack cinder-volume[76059]: we strongly recommend against using it for new projects. Sep 30 10:18:00 devstack cinder-volume[76059]: If you are already using Eventlet, we recommend migrating to a different Sep 30 10:18:00 devstack cinder-volume[76059]: framework. For more detail see Sep 30 10:18:00 devstack cinder-volume[76059]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 10:18:00 devstack cinder-volume[76059]: import eventlet # noqa Sep 30 10:18:03 devstack cinder-volume[76059]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 10:18:03 devstack cinder-volume[76059]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 10:18:03 devstack cinder-volume[76059]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 10:18:04 devstack cinder-volume[76059]: INFO dbcounter [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Registered counter for database cinder Sep 30 10:18:04 devstack cinder-volume[76059]: DEBUG oslo_db.sqlalchemy.engines [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:18:04 devstack cinder-volume[76059]: DEBUG dbcounter [-] [76059] Writer thread running {{(pid=76059) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 10:18:04 devstack cinder-volume[76059]: INFO cinder.rpc [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 30 10:18:04 devstack cinder-volume[76059]: INFO cinder.rpc [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 30 10:18:04 devstack cinder-volume[76059]: DEBUG oslo_db.sqlalchemy.engines [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:18:04 devstack cinder-volume[76059]: INFO cinder.volume.manager [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Determined volume DB was empty at startup. Sep 30 10:18:04 devstack cinder-volume[76059]: DEBUG cinder.volume.manager [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76059) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 30 10:18:04 devstack cinder-volume[76059]: INFO cinder.volume.manager [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 30 10:18:04 devstack cinder-volume[76059]: WARNING stevedore.named [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 10:18:04 devstack cinder-volume[76059]: WARNING castellan.key_manager [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 10:18:04 devstack cinder-volume[76059]: WARNING cinder.keymgr.conf_key_mgr [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 10:18:04 devstack cinder-volume[76059]: DEBUG cinder.volume.drivers.lvm [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76059) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 30 10:18:04 devstack cinder-volume[76059]: DEBUG oslo_concurrency.processutils [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76059) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:04 devstack cinder-volume[76059]: DEBUG oslo_concurrency.processutils [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.384s {{(pid=76059) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_db.sqlalchemy.engines [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:18:05 devstack cinder-volume[76059]: INFO cinder.rpc [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 30 10:18:05 devstack cinder-volume[76059]: INFO cinder.rpc [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 30 10:18:05 devstack cinder-volume[76059]: WARNING stevedore.named [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 10:18:05 devstack cinder-volume[76059]: WARNING castellan.key_manager [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 10:18:05 devstack cinder-volume[76059]: INFO cinder.volume.manager [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_db.sqlalchemy.engines [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:18:05 devstack cinder-volume[76059]: INFO oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Starting 1 workers Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Started child 76207 {{(pid=76059) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Full set of CONF: {{(pid=76059) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] ******************************************************************************** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Configuration options gathered from: {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] ================================================================================ {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] allow_availability_zone_fallback = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] allow_compression_on_image_upload = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] allowed_direct_url_schemes = [] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] api_rate_limit = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] auth_strategy = keystone {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] az_cache_duration = 3600 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_availability_zone = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_host = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_name = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_stats_polling_interval = 60 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backup_api_class = cinder.backup.api.API {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backup_name_template = backup-%s {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76207]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backup_use_same_host = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backup_use_temp_snapshot = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] chap_password = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] chap_username = {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cinder_internal_tenant_project_id = 1e84b3070eea468f8585ccdd3735fb7f {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cinder_internal_tenant_user_id = c8caad66d3bb466e9856803cc5b4b96b {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cloned_volume_same_az = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cluster = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] compression_format = gzip {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] compute_api_class = cinder.compute.nova.API {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] config_dir = [] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] config_source = [] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] control_exchange = openstack {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] debug = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] default_availability_zone = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] default_group_type = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] default_volume_type = lvmdriver-1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] disk_geometry = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] driver_client_cert = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] driver_client_cert_key = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] driver_data_namespace = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] driver_ssl_cert_path = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] driver_ssl_cert_verify = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] driver_use_ssl = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] enable_force_upload = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] enable_new_services = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] enable_unsupported_driver = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] enforce_multipath_for_image_xfer = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] filter_function = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance_api_insecure = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance_api_ssl_compression = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance_ca_certificates_file = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance_catalog_info = image:glance:publicURL {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance_certfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance_keyfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance_num_retries = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance_request_timeout = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] goodness_function = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] graceful_shutdown_timeout = 5 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] group_api_class = cinder.group.api.API {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] host = devstack {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_compress_on_upload = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_conversion_address_space_limit = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_conversion_cpu_limit = 60 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_conversion_disable = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_introspection_address_space_limit = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_introspection_cpu_limit = 60 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_upload_use_cinder_backend = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_upload_use_internal_tenant = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_volume_cache_enabled = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_volume_cache_max_count = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] image_volume_cache_max_size_gb = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] init_host_max_objects_retrieval = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] instance_format = [instance: %(uuid)s] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] iscsi_target_flags = {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] iscsi_write_cache = on {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] iser_helper = tgtadm {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] iser_ip_address = 192.168.122.99 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] iser_port = 3260 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] log_color = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] log_config_append = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] log_dir = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] log_file = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] log_options = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] log_rotate_interval = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] log_rotate_interval_type = days {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] log_rotation_type = none {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] max_age = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] max_logfile_count = 30 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] max_logfile_size_mb = 200 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] max_over_subscription_ratio = 20.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] message_reap_interval = 86400 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] message_ttl = 2592000 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76207]: INFO cinder.volume.manager [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 30 10:18:05 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] migration_create_volume_timeout_secs = 300 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] monkey_patch = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] monkey_patch_modules = [] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] my_ip = 192.168.122.99 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] no_snapshot_gb_quota = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] num_iser_scan_tries = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] num_shell_tries = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] num_volume_device_scan_tries = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] nvmeof_conn_info_version = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] nvmet_ns_id = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] nvmet_port_id = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] osapi_max_limit = 1000 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] osapi_volume_ext_list = [] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] osapi_volume_listen_port = 8776 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] osapi_volume_use_ssl = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] osapi_volume_workers = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] per_volume_size_limit = -1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] periodic_fuzzy_delay = 60 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] periodic_interval = 60 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] public_endpoint = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] publish_errors = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] quota_backup_gigabytes = 1000 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] quota_backups = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] quota_gigabytes = 1000 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] quota_groups = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] quota_snapshots = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] quota_volumes = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] rate_limit_burst = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] rate_limit_except_level = CRITICAL {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] rate_limit_interval = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] reinit_driver_count = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] replication_device = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] report_discard_supported = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] report_interval = 120 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] reservation_clean_interval = 86400 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] reservation_expire = 86400 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] reserved_image_namespaces = [] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] reserved_percentage = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] rpc_response_timeout = 120 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] run_external_periodic_tasks = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] scst_target_driver = iscsi {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] scst_target_iqn_name = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_down_time = 720 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] shell_completion = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] snapshot_name_template = snapshot-%s {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] snapshot_same_host = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] split_loggers = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] state_path = /opt/stack/data/cinder {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] storage_availability_zone = nova {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] storage_protocol = iSCSI {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] syslog_log_facility = LOG_USER {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] target_helper = lioadm {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] target_ip_address = 192.168.122.99 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] target_port = 3260 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] target_protocol = iscsi {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] target_secondary_ip_addresses = [] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] trace_flags = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] transport_url = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] until_refresh = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] use_chap_auth = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] use_default_quota_class = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] use_journal = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] use_json = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] use_multipath_for_image_xfer = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] use_stderr = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] use_syslog = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] verify_glance_signatures = enabled {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_api_class = cinder.volume.api.API {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_backend_name = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_clear = zero {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_clear_ionice = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_clear_size = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_copy_bps_limit = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_dd_blocksize = 1M {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_name_template = volume-%s {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_service_inithost_offload = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volume_usage_audit_period = month {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] zoning_mode = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_concurrency.disable_process_locking = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.auth_section = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.auth_type = password {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.auth_version = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.cache = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.certfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.include_service_catalog = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.insecure = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.interface = public {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.keyfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_password = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcache_username = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.region_name = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.service_type = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.067s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.backend = dogpile.cache.null {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.backend_argument = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.backend_expiration_time = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.config_prefix = cache.oslo {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.debug_cache_backend = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.enable_retry_client = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.enable_socket_keepalive = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.enabled = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.expiration_time = 600 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.hashclient_retry_attempts = 2 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.memcache_dead_retry = 300 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.memcache_pool_maxsize = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.memcache_sasl_enabled = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.password = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.proxies = [] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.redis_db = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.redis_server = localhost:6379 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.retry_attempts = 2 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.retry_delay = 0.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.socket_keepalive_count = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.socket_keepalive_idle = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.socket_keepalive_interval = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.socket_timeout = 1.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.tls_allowed_ciphers = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.tls_cafile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.tls_certfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.tls_enabled = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.tls_keyfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cache.username = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] coordination.backend_url = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.asyncio_connection = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.asyncio_slave_connection = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.backend = sqlalchemy {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.connection = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.connection_debug = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.connection_parameters = {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:05 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.connection_recycle_time = 3600 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.connection_trace = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.db_inc_retry_interval = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.db_max_retries = 20 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.db_max_retry_interval = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.db_retry_interval = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.max_overflow = 50 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.max_pool_size = 5 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.max_retries = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.mysql_wsrep_sync_wait = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.pool_timeout = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.retry_interval = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.slave_connection = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.sqlite_synchronous = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.synchronous_reader = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] database.use_db_reconnect = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_tracing.insecure = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.connection_string = messaging:// {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.enabled = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.es_doc_type = notification {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.es_scroll_size = 10000 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.es_scroll_time = 2m {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.filter_error_trace = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.hmac_keys = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.sentinel_service_name = mymaster {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.socket_timeout = 0.1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.trace_requests = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler.trace_sqlalchemy = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler_jaeger.process_tags = {} {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler_jaeger.service_name_prefix = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] profiler_otlp.service_name_prefix = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_policy.enforce_new_defaults = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_policy.policy_default_rule = default {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_policy.policy_file = policy.yaml {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] privsep_osbrick.group = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] privsep_osbrick.helper_command = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] privsep_osbrick.user = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cinder_sys_admin.group = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cinder_sys_admin.helper_command = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] cinder_sys_admin.user = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.auth_section = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.auth_type = password {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.cafile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.certfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.collect_timing = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.insecure = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.keyfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.send_service_user_token = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.split_loggers = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.timeout = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.tls_ciphers = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] service_user.tls_min_version = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:05 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.auth_section = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.auth_type = password {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.certfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.collect_timing = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.insecure = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.keyfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.region_name = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.split_loggers = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.timeout = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.tls_ciphers = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] glance.tls_min_version = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.backend_availability_zone = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.chap_password = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.chap_username = {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.disk_geometry = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.driver_client_cert = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.driver_client_cert_key = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.driver_data_namespace = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.driver_use_ssl = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.extra_capabilities = {} {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.filter_function = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.goodness_function = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.iscsi_target_flags = {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.iscsi_write_cache = on {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.iser_helper = tgtadm {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.iser_port = 3260 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.lvm_share_target = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.lvm_type = auto {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.num_shell_tries = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.replication_device = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.report_discard_supported = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.reserved_percentage = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.target_helper = tgtadm {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.target_port = 3260 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.target_protocol = iscsi {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.trace_flags = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.unique_fqdn_network = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.use_chap_auth = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.volume_backend_name = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.volume_clear = zero {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.volume_clear_ionice = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.volume_clear_size = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_reports.file_event_handler = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack sudo[76211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_reports.log_dir = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.backend_host = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.chap_password = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack sudo[76211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.chap_username = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.disk_geometry = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.driver_client_cert = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.extra_capabilities = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.filter_function = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.goodness_function = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.iser_helper = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.iser_ip_address = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.iser_port = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.lvm_share_target = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.lvm_type = auto {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.num_shell_tries = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.replication_device = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.report_discard_supported = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.reserved_percentage = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.scst_target_driver = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.storage_protocol = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.target_helper = lioadm {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.target_ip_address = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.target_port = 3260 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.trace_flags = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.use_chap_auth = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.volume_clear = zero {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.volume_clear_size = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] lvmdriver-1.volumes_dir = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.ssl = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_notifications.driver = [] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_notifications.retry = -1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] key_manager.fixed_key = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.barbican_api_version = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.barbican_endpoint = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.barbican_endpoint_type = public {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.barbican_region_name = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.cafile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.certfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.collect_timing = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.insecure = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.keyfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.number_of_retries = 60 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.retry_delay = 1 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.send_service_user_token = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.split_loggers = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.timeout = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.tls_ciphers = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.tls_min_version = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.verify_ssl = True {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican.verify_ssl_path = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.auth_section = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.auth_type = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.cafile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.certfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.collect_timing = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.insecure = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.keyfile = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.split_loggers = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.timeout = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.tls_ciphers = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] barbican_service_user.tls_min_version = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.approle_role_id = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.approle_secret_id = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.auth_method = approle {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.auth_path = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.kv_mountpoint = secret {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.kv_path = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.kv_version = 2 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.namespace = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.root_token_id = **** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.ssl_ca_crt_file = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.timeout = 60.0 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.token_file = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.token_role = None {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.use_ssl = False {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:18:05 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] ******************************************************************************** {{(pid=76059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 30 10:18:05 devstack sudo[76211]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:05 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:05 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:05 devstack sudo[76214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:18:05 devstack sudo[76214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:06 devstack sudo[76214]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.304s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:18:06 devstack cinder-volume[76207]: INFO cinder.brick.local_dev.lvm [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:06 devstack sudo[76220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 10:18:06 devstack sudo[76220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:06 devstack sudo[76220]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG cinder.brick.local_dev.lvm [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76207) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:06 devstack sudo[76263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:18:06 devstack sudo[76263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:06 devstack sudo[76263]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.561s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:06 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:07 devstack sudo[76488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:18:07 devstack sudo[76488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:07 devstack sudo[76488]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:07 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:07 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:07 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:07 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:07 devstack sudo[76598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 30 10:18:07 devstack sudo[76598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:07 devstack sudo[76598]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:07 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.269s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:07 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:07 devstack sudo[76683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 10:18:07 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:07 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:07 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:07 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:07 devstack sudo[76754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 10:18:07 devstack sudo[76754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:08 devstack sudo[76754]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:08 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:08 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:08 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:18:08 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:08 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:08 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:08 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:08 devstack sudo[76840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:18:08 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:08 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:08 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.342s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:08 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:08 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:08 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:08 devstack sudo[76920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:18:08 devstack sudo[76920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:08 devstack sudo[76920]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:08 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:08 devstack cinder-volume[76207]: INFO cinder.volume.drivers.lvm [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 30 10:18:08 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:09 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:09 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:09 devstack sudo[76936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:18:09 devstack sudo[76936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:09 devstack sudo[76936]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:09 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:09 devstack cinder-volume[76207]: DEBUG cinder.volume.drivers.lvm [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Updating volume stats {{(pid=76207) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 10:18:09 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:09 devstack sudo[76997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 10:18:09 devstack sudo[76997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:09 devstack sudo[76997]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:09 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:09 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:09 devstack sudo[77022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:18:09 devstack sudo[77022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:09 devstack sudo[77022]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:09 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:09 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:09 devstack sudo[77026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:18:09 devstack sudo[77026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:10 devstack sudo[77026]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:10 devstack sudo[77035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:18:10 devstack sudo[77035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:10 devstack sudo[77035]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:10 devstack cinder-volume[76207]: INFO cinder.volume.driver [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Driver hasn't implemented _init_vendor_properties() Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG cinder.volume.driver [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76207) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG oslo_db.sqlalchemy.engines [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG dbcounter [-] [76207] Writer thread running {{(pid=76207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG cinder.db.api [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Building query based on filter {{(pid=76207) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG cinder.image.image_utils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76207) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 30 10:18:10 devstack cinder-volume[76207]: INFO cinder.keymgr.migration [None req-91e12735-e36d-48aa-99c3-9a4d370644b6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG cinder.volume.drivers.lvm [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Updating volume stats {{(pid=76207) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:10 devstack sudo[77039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 10:18:10 devstack sudo[77039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:10 devstack sudo[77039]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:10 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:10 devstack sudo[77042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:18:10 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:11 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:11 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:11 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:11 devstack sudo[77045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:18:11 devstack sudo[77045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:11 devstack sudo[77045]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:11 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:11 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:11 devstack sudo[77048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:18:11 devstack sudo[77048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:11 devstack sudo[77048]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:11 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:11 devstack cinder-volume[76207]: DEBUG cinder.manager [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Notifying Schedulers of capabilities ... {{(pid=76207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:18:11 devstack cinder-volume[76207]: INFO cinder.volume.manager [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Driver initialization completed successfully. Sep 30 10:18:11 devstack cinder-volume[76207]: INFO cinder.manager [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Initiating service 2 cleanup Sep 30 10:18:11 devstack cinder-volume[76207]: INFO cinder.manager [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Service 2 cleanup completed. Sep 30 10:18:11 devstack cinder-volume[76207]: DEBUG cinder.service [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Creating RPC server for service cinder-volume {{(pid=76207) start /opt/stack/cinder/cinder/service.py:231}} Sep 30 10:18:11 devstack cinder-volume[76207]: DEBUG cinder.service [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76207) start /opt/stack/cinder/cinder/service.py:237}} Sep 30 10:18:11 devstack cinder-volume[76207]: INFO cinder.volume.manager [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 30 10:18:11 devstack cinder-volume[76207]: DEBUG cinder.volume.drivers.lvm [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Updating volume stats {{(pid=76207) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 10:18:11 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:11 devstack sudo[77054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 10:18:11 devstack sudo[77054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:12 devstack sudo[77054]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:12 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:12 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:12 devstack sudo[77057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:18:12 devstack sudo[77057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:12 devstack sudo[77057]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:12 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:12 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:12 devstack sudo[77060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:18:12 devstack sudo[77060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:12 devstack sudo[77060]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:12 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:12 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:18:12 devstack sudo[77063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:18:12 devstack sudo[77063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:18:12 devstack sudo[77063]: pam_unix(sudo:session): session closed for user root Sep 30 10:18:12 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:18:12 devstack cinder-volume[76207]: INFO cinder.volume.manager [None req-96b19209-82de-48af-b08a-298e57ffc06c None None] Driver post RPC initialization completed successfully. Sep 30 10:18:15 devstack cinder-volume[76059]: DEBUG dbcounter [-] [76059] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76059) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:18:16 devstack cinder-volume[76207]: DEBUG oslo_service.periodic_task [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running periodic task VolumeManager._thread_info {{(pid=76207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:18:16 devstack cinder-volume[76207]: DEBUG cinder.volume.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] thread count: 6 {{(pid=76207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:18:16 devstack cinder-volume[76207]: DEBUG cinder.volume.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] thread info: [<_MainThread(MainThread, started 133837222457472)>, , , , , ] {{(pid=76207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:18:22 devstack cinder-volume[76207]: DEBUG dbcounter [-] [76207] Writing DB stats cinder:SELECT=4 {{(pid=76207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:18:22 devstack cinder-volume[76207]: DEBUG dbcounter [-] [76207] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:19:16 devstack cinder-volume[76207]: DEBUG oslo_service.periodic_task [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:19:16 devstack cinder-volume[76207]: DEBUG cinder.volume.drivers.lvm [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Updating volume stats {{(pid=76207) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 10:19:16 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:19:16 devstack sudo[79028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 10:19:16 devstack sudo[79028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:19:17 devstack sudo[79028]: pam_unix(sudo:session): session closed for user root Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:19:17 devstack sudo[79031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:19:17 devstack sudo[79031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:19:17 devstack sudo[79031]: pam_unix(sudo:session): session closed for user root Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:19:17 devstack sudo[79034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:19:17 devstack sudo[79034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:19:17 devstack sudo[79034]: pam_unix(sudo:session): session closed for user root Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:19:17 devstack sudo[79037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:19:17 devstack sudo[79037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:19:17 devstack sudo[79037]: pam_unix(sudo:session): session closed for user root Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG cinder.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Notifying Schedulers of capabilities ... {{(pid=76207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG oslo_service.periodic_task [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running periodic task VolumeManager._thread_info {{(pid=76207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG cinder.volume.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] thread count: 6 {{(pid=76207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:19:17 devstack cinder-volume[76207]: DEBUG cinder.volume.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] thread info: [<_MainThread(MainThread, started 133837222457472)>, , , , , ] {{(pid=76207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:20:16 devstack cinder-volume[76207]: DEBUG oslo_service.periodic_task [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:20:16 devstack cinder-volume[76207]: DEBUG cinder.volume.drivers.lvm [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Updating volume stats {{(pid=76207) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 10:20:16 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:20:16 devstack sudo[82403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 10:20:16 devstack sudo[82403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:20:17 devstack sudo[82403]: pam_unix(sudo:session): session closed for user root Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:20:17 devstack sudo[82422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:20:17 devstack sudo[82422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:20:17 devstack sudo[82422]: pam_unix(sudo:session): session closed for user root Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:20:17 devstack sudo[82425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:20:17 devstack sudo[82425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:20:17 devstack sudo[82425]: pam_unix(sudo:session): session closed for user root Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:20:17 devstack sudo[82428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:20:17 devstack sudo[82428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:20:17 devstack sudo[82428]: pam_unix(sudo:session): session closed for user root Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG cinder.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Notifying Schedulers of capabilities ... {{(pid=76207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG oslo_service.periodic_task [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running periodic task VolumeManager._thread_info {{(pid=76207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG cinder.volume.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] thread count: 6 {{(pid=76207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:20:17 devstack cinder-volume[76207]: DEBUG cinder.volume.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] thread info: [<_MainThread(MainThread, started 133837222457472)>, , , , , ] {{(pid=76207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:20:22 devstack cinder-volume[76207]: DEBUG dbcounter [-] [76207] Writing DB stats cinder:SELECT=1 {{(pid=76207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:20:22 devstack cinder-volume[76207]: DEBUG dbcounter [-] [76207] Writing DB stats cinder:UPDATE=1 {{(pid=76207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:21:16 devstack cinder-volume[76207]: DEBUG oslo_service.periodic_task [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:21:16 devstack cinder-volume[76207]: DEBUG cinder.volume.drivers.lvm [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Updating volume stats {{(pid=76207) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 10:21:16 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:21:16 devstack sudo[84496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 10:21:16 devstack sudo[84496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:21:17 devstack sudo[84496]: pam_unix(sudo:session): session closed for user root Sep 30 10:21:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:21:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:21:17 devstack sudo[84507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:21:17 devstack sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:21:17 devstack sudo[84507]: pam_unix(sudo:session): session closed for user root Sep 30 10:21:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:21:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:21:17 devstack sudo[84511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:21:17 devstack sudo[84511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:21:17 devstack sudo[84511]: pam_unix(sudo:session): session closed for user root Sep 30 10:21:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:21:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:21:17 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:21:17 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:21:17 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Sep 30 10:21:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:21:17 devstack cinder-volume[76207]: DEBUG cinder.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Notifying Schedulers of capabilities ... {{(pid=76207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:22:16 devstack cinder-volume[76207]: DEBUG oslo_service.periodic_task [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:22:16 devstack cinder-volume[76207]: DEBUG cinder.volume.drivers.lvm [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Updating volume stats {{(pid=76207) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 10:22:16 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:16 devstack sudo[85711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 10:22:16 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:17 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:17 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:22:17 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:17 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:17 devstack sudo[85728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 10:22:17 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:17 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:17 devstack sudo[85731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 10:22:17 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:17 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG cinder.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Notifying Schedulers of capabilities ... {{(pid=76207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG oslo_service.periodic_task [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] Running periodic task VolumeManager._thread_info {{(pid=76207) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG cinder.volume.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] thread count: 6 {{(pid=76207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:22:17 devstack cinder-volume[76207]: DEBUG cinder.volume.manager [None req-b4c2b5ab-ea74-49f2-a7e7-0b23692e34a1 None None] thread info: [<_MainThread(MainThread, started 133837222457472)>, , , , , ] {{(pid=76207) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:22:22 devstack cinder-volume[76207]: DEBUG dbcounter [-] [76207] Writing DB stats cinder:SELECT=1 {{(pid=76207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:22:22 devstack cinder-volume[76207]: DEBUG dbcounter [-] [76207] Writing DB stats cinder:UPDATE=1 {{(pid=76207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:22:33 devstack cinder-volume[76059]: INFO oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Caught SIGTERM, stopping children Sep 30 10:22:33 devstack cinder-volume[76059]: DEBUG oslo_concurrency.lockutils [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Acquiring lock "singleton_lock" {{(pid=76059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 10:22:33 devstack cinder-volume[76059]: DEBUG oslo_concurrency.lockutils [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Acquired lock "singleton_lock" {{(pid=76059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 10:22:33 devstack cinder-volume[76059]: DEBUG oslo_concurrency.lockutils [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Releasing lock "singleton_lock" {{(pid=76059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 10:22:33 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Stop services. {{(pid=76059) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 30 10:22:33 devstack cinder-volume[76059]: DEBUG oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Killing children. {{(pid=76059) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 30 10:22:33 devstack cinder-volume[76059]: INFO oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Waiting on 1 children to exit Sep 30 10:22:36 devstack cinder-volume[76207]: DEBUG oslo_concurrency.lockutils [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Acquiring lock "singleton_lock" {{(pid=76207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 10:22:36 devstack cinder-volume[76207]: DEBUG oslo_concurrency.lockutils [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Acquired lock "singleton_lock" {{(pid=76207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 10:22:36 devstack cinder-volume[76207]: DEBUG oslo_concurrency.lockutils [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Releasing lock "singleton_lock" {{(pid=76207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 10:22:36 devstack cinder-volume[76207]: WARNING amqp [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 10:22:36 devstack cinder-volume[76207]: WARNING amqp [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 10:22:36 devstack cinder-volume[76059]: INFO oslo_service.backend._eventlet.service [None req-004d47ea-e8f9-47f8-af53-5edc9b6b76c7 None None] Child 76207 exited with status 0 Sep 30 10:22:37 devstack cinder-volume[86181]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 30 10:22:37 devstack cinder-volume[86181]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 10:22:37 devstack cinder-volume[86181]: we strongly recommend against using it for new projects. Sep 30 10:22:37 devstack cinder-volume[86181]: If you are already using Eventlet, we recommend migrating to a different Sep 30 10:22:37 devstack cinder-volume[86181]: framework. For more detail see Sep 30 10:22:37 devstack cinder-volume[86181]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 10:22:37 devstack cinder-volume[86181]: import eventlet # noqa Sep 30 10:22:39 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 10:22:39 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 10:22:39 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 10:22:39 devstack cinder-volume[86181]: INFO dbcounter [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Registered counter for database cinder Sep 30 10:22:39 devstack cinder-volume[86181]: DEBUG oslo_db.sqlalchemy.engines [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG dbcounter [-] [86181] Writer thread running {{(pid=86181) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 10:22:40 devstack cinder-volume[86181]: INFO cinder.rpc [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 30 10:22:40 devstack cinder-volume[86181]: INFO cinder.rpc [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_db.sqlalchemy.engines [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:22:40 devstack cinder-volume[86181]: INFO cinder.volume.manager [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Determined volume DB was empty at startup. Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG cinder.volume.manager [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86181) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 30 10:22:40 devstack cinder-volume[86181]: INFO cinder.volume.manager [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 30 10:22:40 devstack cinder-volume[86181]: WARNING stevedore.named [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 10:22:40 devstack cinder-volume[86181]: WARNING castellan.key_manager [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 10:22:40 devstack cinder-volume[86181]: WARNING cinder.keymgr.conf_key_mgr [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 10:22:40 devstack cinder-volume[86181]: INFO cinder.volume.manager [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_db.sqlalchemy.engines [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:22:40 devstack cinder-volume[86181]: INFO oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Starting 1 workers Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Started child 86397 {{(pid=86181) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Full set of CONF: {{(pid=86181) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] ******************************************************************************** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Configuration options gathered from: {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] ================================================================================ {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] allow_availability_zone_fallback = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] allow_compression_on_image_upload = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] allowed_direct_url_schemes = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] api_rate_limit = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] auth_strategy = keystone {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_availability_zone = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86397]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_host = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_stats_polling_interval = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backup_api_class = cinder.backup.api.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backup_name_template = backup-%s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backup_use_same_host = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backup_use_temp_snapshot = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] chap_password = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] chap_username = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cinder_internal_tenant_project_id = 1e84b3070eea468f8585ccdd3735fb7f {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cinder_internal_tenant_user_id = c8caad66d3bb466e9856803cc5b4b96b {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cluster = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] compression_format = gzip {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] compute_api_class = cinder.compute.nova.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] config_dir = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] config_source = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] control_exchange = openstack {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] debug = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] default_availability_zone = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] default_group_type = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] default_volume_type = QuobyteHD {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] disk_geometry = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] driver_client_cert = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] driver_client_cert_key = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] driver_data_namespace = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] driver_ssl_cert_path = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] driver_ssl_cert_verify = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] driver_use_ssl = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] enable_new_services = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] enable_unsupported_driver = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] enabled_backends = ['QuobyteHD'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] enforce_multipath_for_image_xfer = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] filter_function = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance_api_insecure = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance_api_ssl_compression = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance_ca_certificates_file = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance_catalog_info = image:glance:publicURL {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance_certfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance_keyfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance_num_retries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance_request_timeout = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] goodness_function = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] graceful_shutdown_timeout = 5 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] group_api_class = cinder.group.api.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] host = devstack {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_compress_on_upload = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_conversion_address_space_limit = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_conversion_cpu_limit = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_conversion_disable = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_introspection_address_space_limit = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_introspection_cpu_limit = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_upload_use_cinder_backend = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_upload_use_internal_tenant = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_volume_cache_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_volume_cache_max_count = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] image_volume_cache_max_size_gb = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] init_host_max_objects_retrieval = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] instance_format = [instance: %(uuid)s] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] iscsi_target_flags = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] iscsi_write_cache = on {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] iser_helper = tgtadm {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] iser_ip_address = 192.168.122.99 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] iser_port = 3260 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] log_color = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] log_config_append = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86397]: INFO cinder.volume.manager [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] log_dir = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] log_file = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] log_options = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] log_rotate_interval = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] log_rotate_interval_type = days {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] log_rotation_type = none {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86397]: DEBUG cinder.volume.drivers.remotefs [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86397) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] max_age = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] max_logfile_count = 30 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] max_logfile_size_mb = 200 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] max_over_subscription_ratio = 20.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] message_reap_interval = 86400 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] message_ttl = 2592000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] migration_create_volume_timeout_secs = 300 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] monkey_patch = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] monkey_patch_modules = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] my_ip = 192.168.122.99 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] no_snapshot_gb_quota = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] num_iser_scan_tries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] num_shell_tries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] num_volume_device_scan_tries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] nvmeof_conn_info_version = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] nvmet_ns_id = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] nvmet_port_id = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] osapi_max_limit = 1000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] osapi_volume_ext_list = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] osapi_volume_listen_port = 8776 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] osapi_volume_use_ssl = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] osapi_volume_workers = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] per_volume_size_limit = -1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] periodic_fuzzy_delay = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] periodic_interval = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] public_endpoint = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] publish_errors = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] quota_backup_gigabytes = 1000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] quota_backups = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] quota_gigabytes = 1000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] quota_groups = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] quota_snapshots = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] quota_volumes = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] rate_limit_burst = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] rate_limit_except_level = CRITICAL {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] rate_limit_interval = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] reinit_driver_count = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] replication_device = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] report_discard_supported = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] report_interval = 120 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] reservation_clean_interval = 86400 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] reservation_expire = 86400 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] reserved_image_namespaces = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] reserved_percentage = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] rpc_response_timeout = 120 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] run_external_periodic_tasks = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] scst_target_driver = iscsi {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] scst_target_iqn_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_down_time = 720 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] shell_completion = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] snapshot_name_template = snapshot-%s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] split_loggers = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] state_path = /opt/stack/data/cinder {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] storage_availability_zone = nova {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] storage_protocol = iSCSI {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] syslog_log_facility = LOG_USER {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] target_helper = lioadm {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] target_ip_address = 192.168.122.99 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] target_port = 3260 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] target_protocol = iscsi {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] target_secondary_ip_addresses = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] trace_flags = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] transport_url = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] until_refresh = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] use_chap_auth = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] use_default_quota_class = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] use_journal = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] use_json = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] use_multipath_for_image_xfer = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] use_stderr = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] use_syslog = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] verify_glance_signatures = enabled {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_api_class = cinder.volume.api.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_backend_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_clear = zero {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_clear_ionice = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_clear_size = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_copy_bps_limit = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_dd_blocksize = 1M {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_name_template = volume-%s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_service_inithost_offload = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volume_usage_audit_period = month {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] zoning_mode = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_concurrency.disable_process_locking = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.auth_section = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.auth_type = password {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.auth_version = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.cache = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.certfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.include_service_catalog = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.insecure = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.interface = public {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.keyfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_password = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86397]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86397) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 30 10:22:40 devstack cinder-volume[86397]: WARNING cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 30 10:22:40 devstack cinder-volume[86397]: WARNING cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcache_username = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.region_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.service_type = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.backend = dogpile.cache.null {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.backend_argument = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.backend_expiration_time = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.config_prefix = cache.oslo {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.debug_cache_backend = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.enable_retry_client = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.enable_socket_keepalive = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.expiration_time = 600 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.hashclient_retry_attempts = 2 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.memcache_dead_retry = 300 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.memcache_pool_maxsize = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.memcache_sasl_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.password = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.proxies = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.redis_db = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.redis_server = localhost:6379 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.retry_attempts = 2 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.retry_delay = 0.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.socket_keepalive_count = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.socket_keepalive_idle = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.socket_keepalive_interval = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.socket_timeout = 1.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.tls_allowed_ciphers = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.tls_cafile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.tls_certfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.tls_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.tls_keyfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cache.username = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] coordination.backend_url = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.asyncio_connection = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.asyncio_slave_connection = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.backend = sqlalchemy {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.connection = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.connection_debug = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.connection_parameters = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.connection_recycle_time = 3600 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.connection_trace = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.db_inc_retry_interval = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.db_max_retries = 20 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.db_max_retry_interval = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.db_retry_interval = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.max_overflow = 50 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.max_pool_size = 5 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.max_retries = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.mysql_wsrep_sync_wait = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.pool_timeout = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.retry_interval = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.slave_connection = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.sqlite_synchronous = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.synchronous_reader = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] database.use_db_reconnect = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_tracing.insecure = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.connection_string = messaging:// {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.es_doc_type = notification {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.es_scroll_size = 10000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.es_scroll_time = 2m {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.filter_error_trace = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.hmac_keys = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.sentinel_service_name = mymaster {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.socket_timeout = 0.1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.trace_requests = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler.trace_sqlalchemy = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler_jaeger.process_tags = {} {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler_jaeger.service_name_prefix = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] profiler_otlp.service_name_prefix = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_policy.enforce_new_defaults = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_policy.policy_default_rule = default {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_policy.policy_file = policy.yaml {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] privsep_osbrick.group = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] privsep_osbrick.helper_command = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] privsep_osbrick.user = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cinder_sys_admin.group = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cinder_sys_admin.helper_command = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] cinder_sys_admin.user = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.auth_section = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.auth_type = password {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.cafile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.certfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.collect_timing = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.insecure = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.keyfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.send_service_user_token = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.split_loggers = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.timeout = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.tls_ciphers = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] service_user.tls_min_version = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.auth_section = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.auth_type = password {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.certfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.collect_timing = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.insecure = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.keyfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.region_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.split_loggers = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.timeout = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.tls_ciphers = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] glance.tls_min_version = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.backend_availability_zone = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.chap_password = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.chap_username = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.disk_geometry = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.driver_client_cert = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.driver_client_cert_key = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.driver_data_namespace = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.driver_use_ssl = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.extra_capabilities = {} {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.filter_function = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.goodness_function = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.iscsi_target_flags = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.iscsi_write_cache = on {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.iser_helper = tgtadm {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.iser_port = 3260 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nas_host = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nas_login = admin {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nas_mount_options = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nas_password = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nas_private_key = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nas_share_path = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.num_shell_tries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.quobyte_volume_url = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.replication_device = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.report_discard_supported = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.reserved_percentage = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.target_helper = tgtadm {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.target_port = 3260 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.target_protocol = iscsi {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.trace_flags = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.unique_fqdn_network = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.use_chap_auth = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.volume_backend_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.volume_clear = zero {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.volume_clear_ionice = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.volume_clear_size = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_reports.file_event_handler = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_reports.log_dir = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.backend_availability_zone = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.backend_host = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.chap_password = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.chap_username = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.chiscsi_conf = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.disk_geometry = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.driver_client_cert = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.driver_data_namespace = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.driver_use_ssl = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.extra_capabilities = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.filter_function = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.goodness_function = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.iser_helper = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.iser_ip_address = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.iser_port = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.iser_target_prefix = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nas_host = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nas_login = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nas_mount_options = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nas_password = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] CMD "mount.quobyte" returned: 1 in 0.155s {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nas_private_key = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nas_share_path = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nas_ssh_port = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86397]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=86397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:40 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.num_shell_tries = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86397]: INFO cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb ... Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a -c /etc/quobyte/client-cinder.cfg {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.nvmet_port_id = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.replication_device = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.report_discard_supported = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.reserved_percentage = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.scst_target_driver = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.storage_protocol = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.target_helper = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.target_ip_address = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.target_port = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.target_prefix = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.target_protocol = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.trace_flags = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.use_chap_auth = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.volume_clear = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.volume_clear_size = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a -c /etc/quobyte/client-cinder.cfg Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] QuobyteHD.volumes_dir = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.ssl = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_notifications.driver = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_notifications.retry = -1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] key_manager.fixed_key = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.barbican_api_version = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.barbican_endpoint = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.barbican_endpoint_type = public {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.barbican_region_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.cafile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.certfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.collect_timing = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.insecure = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.keyfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.number_of_retries = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.retry_delay = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.send_service_user_token = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.split_loggers = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.timeout = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.tls_ciphers = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.tls_min_version = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.verify_ssl = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican.verify_ssl_path = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.auth_section = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.auth_type = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.cafile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.certfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.collect_timing = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.insecure = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.keyfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.split_loggers = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.timeout = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.tls_ciphers = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] barbican_service_user.tls_min_version = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.approle_role_id = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.approle_secret_id = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.auth_method = approle {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.auth_path = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.kv_mountpoint = secret {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.kv_path = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.kv_version = 2 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.namespace = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.root_token_id = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.ssl_ca_crt_file = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.timeout = 60.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.token_file = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.token_role = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.use_ssl = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:41 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] ******************************************************************************** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 30 10:22:41 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.442s {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:41 devstack cinder-volume[86397]: INFO cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb succeeded Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=86397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.456s {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:41 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:22:41 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:41 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.255s {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:41 devstack cinder-volume[86397]: INFO cinder.volume.driver [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Driver hasn't implemented _init_vendor_properties() Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG cinder.volume.driver [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.958896636963, 'free_capacity_gb': 1774.958896636963, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86397) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG oslo_db.sqlalchemy.engines [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG dbcounter [-] [86397] Writer thread running {{(pid=86397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG cinder.db.api [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Building query based on filter {{(pid=86397) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG cinder.image.image_utils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86397) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 30 10:22:41 devstack cinder-volume[86397]: INFO cinder.keymgr.migration [None req-0244aa73-9247-41e5-b785-dd9a70a864c4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=86397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=86397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:22:41 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:41 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:22:41 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:42 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.246s {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG cinder.manager [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Notifying Schedulers of capabilities ... {{(pid=86397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:22:42 devstack cinder-volume[86397]: INFO cinder.volume.manager [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Driver initialization completed successfully. Sep 30 10:22:42 devstack cinder-volume[86397]: INFO cinder.manager [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Initiating service 3 cleanup Sep 30 10:22:42 devstack cinder-volume[86397]: INFO cinder.manager [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Service 3 cleanup completed. Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG cinder.service [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Creating RPC server for service cinder-volume {{(pid=86397) start /opt/stack/cinder/cinder/service.py:231}} Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG cinder.service [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86397) start /opt/stack/cinder/cinder/service.py:237}} Sep 30 10:22:42 devstack cinder-volume[86397]: INFO cinder.volume.manager [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=86397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=86397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:42 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:22:42 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:42 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:42 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.445s {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:42 devstack cinder-volume[86397]: INFO cinder.volume.manager [None req-e5a9852e-42ec-4ae5-aaa3-b6bf14f846e2 None None] Driver post RPC initialization completed successfully. Sep 30 10:22:46 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-425afd01-bcf1-4825-867f-a0f41d561a47 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:22:46 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-425afd01-bcf1-4825-867f-a0f41d561a47 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:22:46 devstack cinder-volume[86397]: DEBUG cinder.volume.drivers.quobyte [None req-425afd01-bcf1-4825-867f-a0f41d561a47 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=86397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:22:46 devstack cinder-volume[86397]: DEBUG cinder.volume.drivers.quobyte [None req-425afd01-bcf1-4825-867f-a0f41d561a47 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=86397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:22:46 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-425afd01-bcf1-4825-867f-a0f41d561a47 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:22:46 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-425afd01-bcf1-4825-867f-a0f41d561a47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:46 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:22:46 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:46 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:46 devstack cinder-volume[86397]: DEBUG oslo_concurrency.processutils [None req-425afd01-bcf1-4825-867f-a0f41d561a47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.232s {{(pid=86397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:46 devstack cinder-volume[86397]: DEBUG cinder.manager [None req-425afd01-bcf1-4825-867f-a0f41d561a47 None None] Notifying Schedulers of capabilities ... {{(pid=86397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:22:47 devstack cinder-volume[86181]: INFO oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Caught SIGTERM, stopping children Sep 30 10:22:47 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Acquiring lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 10:22:47 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Acquired lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 10:22:47 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Releasing lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 10:22:47 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Stop services. {{(pid=86181) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 30 10:22:47 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Killing children. {{(pid=86181) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 30 10:22:47 devstack cinder-volume[86181]: INFO oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Waiting on 1 children to exit Sep 30 10:22:50 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Acquiring lock "singleton_lock" {{(pid=86397) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 10:22:50 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Acquired lock "singleton_lock" {{(pid=86397) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 10:22:50 devstack cinder-volume[86397]: DEBUG oslo_concurrency.lockutils [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Releasing lock "singleton_lock" {{(pid=86397) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 10:22:50 devstack cinder-volume[86397]: WARNING amqp [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 10:22:50 devstack cinder-volume[86397]: WARNING amqp [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 10:22:50 devstack cinder-volume[86181]: INFO oslo_service.backend._eventlet.service [None req-5c1fe886-23a3-4404-904d-281bf8ba7318 None None] Child 86397 exited with status 0 Sep 30 10:22:51 devstack cinder-volume[86713]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 30 10:22:51 devstack cinder-volume[86713]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 10:22:51 devstack cinder-volume[86713]: we strongly recommend against using it for new projects. Sep 30 10:22:51 devstack cinder-volume[86713]: If you are already using Eventlet, we recommend migrating to a different Sep 30 10:22:51 devstack cinder-volume[86713]: framework. For more detail see Sep 30 10:22:51 devstack cinder-volume[86713]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 10:22:51 devstack cinder-volume[86713]: import eventlet # noqa Sep 30 10:22:53 devstack cinder-volume[86713]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86713) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 10:22:53 devstack cinder-volume[86713]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86713) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 10:22:53 devstack cinder-volume[86713]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86713) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 10:22:54 devstack cinder-volume[86713]: INFO dbcounter [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Registered counter for database cinder Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_db.sqlalchemy.engines [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86713) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG dbcounter [-] [86713] Writer thread running {{(pid=86713) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 10:22:55 devstack cinder-volume[86713]: INFO cinder.rpc [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 30 10:22:55 devstack cinder-volume[86713]: INFO cinder.rpc [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_db.sqlalchemy.engines [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86713) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:22:55 devstack cinder-volume[86713]: INFO cinder.volume.manager [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Determined volume DB was empty at startup. Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG cinder.volume.manager [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86713) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 30 10:22:55 devstack cinder-volume[86713]: WARNING stevedore.named [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 10:22:55 devstack cinder-volume[86713]: WARNING castellan.key_manager [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 10:22:55 devstack cinder-volume[86713]: WARNING cinder.keymgr.conf_key_mgr [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 10:22:55 devstack cinder-volume[86713]: INFO cinder.volume.manager [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_db.sqlalchemy.engines [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86713) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:22:55 devstack cinder-volume[86713]: INFO oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Starting 1 workers Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Started child 87013 {{(pid=86713) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Full set of CONF: {{(pid=86713) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] ******************************************************************************** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] Configuration options gathered from: {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] ================================================================================ {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] allow_availability_zone_fallback = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] allow_compression_on_image_upload = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] allowed_direct_url_schemes = [] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] api_rate_limit = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[87013]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] auth_strategy = keystone {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_availability_zone = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_host = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_name = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_stats_polling_interval = 60 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backup_api_class = cinder.backup.api.API {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backup_name_template = backup-%s {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backup_use_same_host = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backup_use_temp_snapshot = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] chap_password = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] chap_username = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cinder_internal_tenant_project_id = 1e84b3070eea468f8585ccdd3735fb7f {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cinder_internal_tenant_user_id = c8caad66d3bb466e9856803cc5b4b96b {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cluster = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] compression_format = gzip {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] compute_api_class = cinder.compute.nova.API {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] config_dir = [] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] config_source = [] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] control_exchange = openstack {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] debug = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] default_availability_zone = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] default_group_type = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] default_volume_type = QuobyteHD {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] disk_geometry = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] driver_client_cert = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] driver_client_cert_key = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] driver_data_namespace = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] driver_ssl_cert_path = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] driver_ssl_cert_verify = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] driver_use_ssl = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] enable_new_services = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] enable_unsupported_driver = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] enabled_backends = ['QuobyteHD'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] enforce_multipath_for_image_xfer = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] filter_function = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance_api_insecure = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance_api_ssl_compression = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance_ca_certificates_file = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance_catalog_info = image:glance:publicURL {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance_certfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance_keyfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance_num_retries = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance_request_timeout = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] goodness_function = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] graceful_shutdown_timeout = 5 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] group_api_class = cinder.group.api.API {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] host = devstack {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_compress_on_upload = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_conversion_address_space_limit = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_conversion_cpu_limit = 60 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_conversion_disable = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_introspection_address_space_limit = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_introspection_cpu_limit = 60 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_upload_use_cinder_backend = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_upload_use_internal_tenant = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_volume_cache_enabled = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_volume_cache_max_count = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] image_volume_cache_max_size_gb = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] init_host_max_objects_retrieval = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] instance_format = [instance: %(uuid)s] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] iscsi_target_flags = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] iscsi_write_cache = on {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] iser_helper = tgtadm {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] iser_ip_address = 192.168.122.99 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] iser_port = 3260 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] log_color = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] log_config_append = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] log_dir = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Starting volume driver QuobyteDriver (1.2.1) Sep 30 10:22:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87013) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] log_file = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] log_options = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] log_rotate_interval = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] log_rotate_interval_type = days {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] log_rotation_type = none {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] max_age = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] max_logfile_count = 30 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] max_logfile_size_mb = 200 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] max_over_subscription_ratio = 20.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] message_reap_interval = 86400 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] message_ttl = 2592000 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] migration_create_volume_timeout_secs = 300 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] monkey_patch = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] monkey_patch_modules = [] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] my_ip = 192.168.122.99 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] no_snapshot_gb_quota = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] num_iser_scan_tries = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] num_shell_tries = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] num_volume_device_scan_tries = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] nvmeof_conn_info_version = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] nvmet_ns_id = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] nvmet_port_id = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] osapi_max_limit = 1000 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] osapi_volume_ext_list = [] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] osapi_volume_listen = 0.0.0.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] osapi_volume_listen_port = 8776 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] osapi_volume_use_ssl = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] osapi_volume_workers = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] per_volume_size_limit = -1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] periodic_fuzzy_delay = 60 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] periodic_interval = 60 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] project_id_regex = [0-9a-f\-]+ {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] public_endpoint = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] publish_errors = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] quota_backup_gigabytes = 1000 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] quota_backups = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] quota_gigabytes = 1000 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] quota_groups = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] quota_snapshots = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] quota_volumes = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] rate_limit_burst = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] rate_limit_except_level = CRITICAL {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] rate_limit_interval = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] reinit_driver_count = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] replication_device = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] report_discard_supported = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] report_interval = 120 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] reservation_clean_interval = 86400 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] reservation_expire = 86400 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] reserved_image_namespaces = [] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] reserved_percentage = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] rpc_response_timeout = 120 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] run_external_periodic_tasks = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] scst_target_driver = iscsi {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] scst_target_iqn_name = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_down_time = 720 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] shell_completion = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] snapshot_name_template = snapshot-%s {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] split_loggers = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] state_path = /opt/stack/data/cinder {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] storage_availability_zone = nova {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] storage_protocol = iSCSI {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] syslog_log_facility = LOG_USER {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] target_helper = lioadm {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] target_ip_address = 192.168.122.99 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] target_port = 3260 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87013) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 30 10:22:55 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.quobyte [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 30 10:22:55 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.quobyte [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 30 10:22:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Running cmd (subprocess): mount.quobyte {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] target_protocol = iscsi {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] target_secondary_ip_addresses = [] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] trace_flags = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] transfer_api_class = cinder.transfer.api.API {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] transport_url = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] until_refresh = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] use_chap_auth = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] use_default_quota_class = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] use_journal = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] use_json = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] use_multipath_for_image_xfer = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] use_stderr = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] use_syslog = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] verify_glance_signatures = enabled {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_api_class = cinder.volume.api.API {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_backend_name = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_clear = zero {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_clear_ionice = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_clear_size = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_copy_bps_limit = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_dd_blocksize = 1M {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_name_template = volume-%s {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_service_inithost_offload = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volume_usage_audit_period = month {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] zoning_mode = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_concurrency.disable_process_locking = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.auth_section = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.auth_type = password {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.auth_version = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.cache = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.certfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.delay_auth_decision = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.http_connect_timeout = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.include_service_catalog = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.insecure = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.interface = public {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.keyfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_password = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcache_username = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.region_name = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.service_token_roles_required = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.service_type = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.token_cache_time = 300 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.backend = dogpile.cache.null {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack quobyte-client[87014]: Reading configuration file: /etc/quobyte/client.cfg Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.backend_argument = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack quobyte-client[87014]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.backend_expiration_time = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.config_prefix = cache.oslo {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.debug_cache_backend = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.enable_retry_client = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.enable_socket_keepalive = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.enabled = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.expiration_time = 600 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.hashclient_retry_attempts = 2 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.memcache_dead_retry = 300 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.memcache_pool_maxsize = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.memcache_sasl_enabled = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.password = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.proxies = [] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.redis_db = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.redis_sentinel_service_name = mymaster {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.redis_server = localhost:6379 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.retry_attempts = 2 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.retry_delay = 0.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.socket_keepalive_count = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.socket_keepalive_idle = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.socket_keepalive_interval = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.socket_timeout = 1.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.tls_allowed_ciphers = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.tls_cafile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.tls_certfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.tls_enabled = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.tls_keyfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cache.username = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] coordination.backend_url = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.asyncio_connection = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.asyncio_slave_connection = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.backend = sqlalchemy {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.connection = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.connection_debug = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.connection_parameters = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.connection_recycle_time = 3600 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.connection_trace = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.db_inc_retry_interval = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.db_max_retries = 20 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.db_max_retry_interval = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.db_retry_interval = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.max_overflow = 50 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.max_pool_size = 5 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.max_retries = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.mysql_wsrep_sync_wait = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.pool_timeout = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.retry_interval = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.slave_connection = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.sqlite_synchronous = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.synchronous_reader = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] database.use_db_reconnect = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_tracing.insecure = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.connection_string = messaging:// {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.enabled = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.es_doc_type = notification {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.es_scroll_size = 10000 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.es_scroll_time = 2m {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.filter_error_trace = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.hmac_keys = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.sentinel_service_name = mymaster {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.socket_timeout = 0.1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.trace_requests = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler.trace_sqlalchemy = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler_jaeger.process_tags = {} {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler_jaeger.service_name_prefix = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] profiler_otlp.service_name_prefix = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_policy.enforce_new_defaults = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_policy.policy_default_rule = default {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_policy.policy_file = policy.yaml {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_policy.remote_timeout = 60.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] privsep_osbrick.group = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] privsep_osbrick.helper_command = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] privsep_osbrick.user = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cinder_sys_admin.group = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cinder_sys_admin.helper_command = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] cinder_sys_admin.user = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.auth_section = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.auth_type = password {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.cafile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.certfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.collect_timing = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.insecure = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.keyfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.send_service_user_token = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.split_loggers = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.timeout = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.tls_ciphers = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] service_user.tls_min_version = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.auth_section = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.auth_type = password {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.certfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.collect_timing = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.insecure = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.keyfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.region_name = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.split_loggers = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.timeout = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.tls_ciphers = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] glance.tls_min_version = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.backend_availability_zone = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.chap_password = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.chap_username = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.disk_geometry = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.driver_client_cert = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.driver_client_cert_key = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.driver_data_namespace = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.driver_use_ssl = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.enable_unsupported_driver = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.extra_capabilities = {} {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.filter_function = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.goodness_function = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.iscsi_target_flags = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.iscsi_write_cache = on {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.iser_helper = tgtadm {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.iser_port = 3260 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nas_host = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nas_login = admin {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nas_mount_options = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nas_password = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nas_private_key = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nas_share_path = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nas_ssh_port = 22 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.num_shell_tries = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.nvmet_port_id = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.quobyte_client_cfg = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.quobyte_volume_url = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.replication_device = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.report_discard_supported = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.reserved_percentage = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:55 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.scst_target_driver = iscsi {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.scst_target_iqn_name = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.storage_protocol = iSCSI {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.target_helper = tgtadm {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.target_port = 3260 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.target_protocol = iscsi {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.trace_flags = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.unique_fqdn_network = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.use_chap_auth = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.volume_backend_name = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.volume_clear = zero {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.volume_clear_ionice = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.volume_clear_size = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_reports.file_event_handler = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_reports.log_dir = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.backend_availability_zone = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.backend_host = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.chap_password = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.chap_username = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.chiscsi_conf = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.disk_geometry = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.driver_client_cert = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.driver_client_cert_key = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.driver_data_namespace = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.driver_use_ssl = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.extra_capabilities = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.filter_function = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.goodness_function = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.iscsi_target_flags = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.iscsi_write_cache = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.iser_helper = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.iser_ip_address = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.iser_port = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.iser_target_prefix = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nas_host = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nas_login = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nas_mount_options = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nas_password = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nas_private_key = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nas_share_path = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nas_ssh_port = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.num_shell_tries = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nvmet_ns_id = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.nvmet_port_id = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.replication_device = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.report_discard_supported = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.reserved_percentage = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.scst_target_driver = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.storage_protocol = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.target_helper = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.target_ip_address = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.target_port = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.target_prefix = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.target_protocol = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.trace_flags = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.unique_fqdn_network = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.use_chap_auth = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.volume_clear = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.volume_clear_ionice = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.volume_clear_size = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] QuobyteHD.volumes_dir = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.ssl = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.ssl_version = {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_notifications.driver = [] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_notifications.retry = -1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] oslo_messaging_notifications.transport_url = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] key_manager.fixed_key = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.barbican_api_version = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.barbican_endpoint = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.barbican_endpoint_type = public {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.barbican_region_name = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.cafile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.certfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.collect_timing = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.insecure = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.keyfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.number_of_retries = 60 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.retry_delay = 1 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.send_service_user_token = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.split_loggers = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.timeout = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.tls_ciphers = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.tls_min_version = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.verify_ssl = True {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican.verify_ssl_path = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.auth_section = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.auth_type = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.cafile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.certfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.collect_timing = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.insecure = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.keyfile = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.split_loggers = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.timeout = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.tls_ciphers = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] barbican_service_user.tls_min_version = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.approle_role_id = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.approle_secret_id = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.auth_method = approle {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.auth_path = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.kv_mountpoint = secret {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.kv_path = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.kv_version = 2 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.namespace = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.root_token_id = **** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.ssl_ca_crt_file = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.timeout = 60.0 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.token_file = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.token_role = None {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.use_ssl = False {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 10:22:56 devstack cinder-volume[86713]: DEBUG oslo_service.backend._eventlet.service [None req-71b3ff88-80aa-4dca-b471-6eff2e99bfaa None None] ******************************************************************************** {{(pid=86713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 30 10:22:56 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.254s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:56 devstack cinder-volume[87013]: INFO cinder.volume.driver [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Driver hasn't implemented _init_vendor_properties() Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG cinder.volume.driver [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.958896636963, 'free_capacity_gb': 1774.958896636963, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87013) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_db.sqlalchemy.engines [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writer thread running {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG cinder.db.api [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Building query based on filter {{(pid=87013) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87013) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:56 devstack cinder-volume[87013]: INFO cinder.keymgr.migration [None req-c7778794-0d8c-4593-8549-f847275fc99c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 30 10:22:56 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:22:56 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:56 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.231s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:22:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Driver initialization completed successfully. Sep 30 10:22:56 devstack cinder-volume[87013]: INFO cinder.manager [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Initiating service 3 cleanup Sep 30 10:22:56 devstack cinder-volume[87013]: INFO cinder.manager [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Service 3 cleanup completed. Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG cinder.service [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Creating RPC server for service cinder-volume {{(pid=87013) start /opt/stack/cinder/cinder/service.py:231}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG cinder.service [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87013) start /opt/stack/cinder/cinder/service.py:237}} Sep 30 10:22:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:22:56 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:22:56 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:22:56 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Sep 30 10:22:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.244s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:22:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-22b89291-9e66-40ed-8259-9ac299b17a0a None None] Driver post RPC initialization completed successfully. Sep 30 10:23:05 devstack cinder-volume[86713]: DEBUG dbcounter [-] [86713] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86713) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:23:06 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:23:06 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=3 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:23:36 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:23:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 6 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:23:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:23:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-70007f37-c76c-45be-ac3c-11bbc1d87f33 tempest-GroupsV320Test-1928015478 None] Group tempest-GroupsV320Test-Group-739329684: creating Sep 30 10:23:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-70007f37-c76c-45be-ac3c-11bbc1d87f33 tempest-GroupsV320Test-1928015478 None] Group tempest-GroupsV320Test-Group-739329684: created successfully Sep 30 10:23:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-70007f37-c76c-45be-ac3c-11bbc1d87f33 tempest-GroupsV320Test-1928015478 None] Create group completed successfully. Sep 30 10:23:57 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-2c10a09a-dbc5-4474-a636-6f106e04cc03 tempest-GroupsV320Test-1928015478 None] Created reservations ['87659f71-bb3e-49c1-afaf-945700eba4fc'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:23:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2c10a09a-dbc5-4474-a636-6f106e04cc03 tempest-GroupsV320Test-1928015478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:23:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2c10a09a-dbc5-4474-a636-6f106e04cc03 tempest-GroupsV320Test-1928015478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:23:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2c10a09a-dbc5-4474-a636-6f106e04cc03 tempest-GroupsV320Test-1928015478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:23:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2c10a09a-dbc5-4474-a636-6f106e04cc03 tempest-GroupsV320Test-1928015478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:23:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2c10a09a-dbc5-4474-a636-6f106e04cc03 tempest-GroupsV320Test-1928015478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:23:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2c10a09a-dbc5-4474-a636-6f106e04cc03 tempest-GroupsV320Test-1928015478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:23:57 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:23:57 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:23:58 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Sep 30 10:23:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2c10a09a-dbc5-4474-a636-6f106e04cc03 tempest-GroupsV320Test-1928015478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.347s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:23:58 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-2c10a09a-dbc5-4474-a636-6f106e04cc03 tempest-GroupsV320Test-1928015478 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:23:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2c10a09a-dbc5-4474-a636-6f106e04cc03 tempest-GroupsV320Test-1928015478 None] Delete group completed successfully. Sep 30 10:24:07 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:24:07 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Flow 'volume_create_manager' (e02760ee-b6a0-4608-b70d-e142241e634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce7afde-9033-4e41-8350-6485083ec9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce7afde-9033-4e41-8350-6485083ec9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1988162080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea293a9-e6cb-4d82-9753-471fd7ba720e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602730a0f24b496d8664bbfa8416e828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:11Z,use_quota=True,user_id='46d2fd2ee034498ba038be2dc20fdb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2cabb6-03c6-4189-8e51-aa1a6fa678c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2cabb6-03c6-4189-8e51-aa1a6fa678c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd79261f-2896-43d5-b22f-28b6481c8403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd79261f-2896-43d5-b22f-28b6481c8403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ea293a9-e6cb-4d82-9753-471fd7ba720e', 'volume_name': 'volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052a61c2-07ea-4296-b979-ccb4a6bc0271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052a61c2-07ea-4296-b979-ccb4a6bc0271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4ffd70-283f-4598-8c7e-dc64e28224e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:11 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Volume 2ea293a9-e6cb-4d82-9753-471fd7ba720e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e', 'volume_size': 1} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1988162080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea293a9-e6cb-4d82-9753-471fd7ba720e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602730a0f24b496d8664bbfa8416e828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:11Z,use_quota=True,user_id='46d2fd2ee034498ba038be2dc20fdb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Creating volume 2ea293a9-e6cb-4d82-9753-471fd7ba720e {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:24:11 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:24:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:11 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e 1073741824 Sep 30 10:24:11 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:12 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e 1073741824" returned: 0 in 1.275s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:12 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e Sep 30 10:24:12 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:13 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e" returned: 0 in 0.383s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:24:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4ffd70-283f-4598-8c7e-dc64e28224e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56df17eb-0a50-44fd-867a-3f884adc43c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:13 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Volume volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e (2ea293a9-e6cb-4d82-9753-471fd7ba720e): created successfully Sep 30 10:24:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56df17eb-0a50-44fd-867a-3f884adc43c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Flow 'volume_create_manager' (e02760ee-b6a0-4608-b70d-e142241e634c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:13 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-99b5ac66-8a06-440b-b598-9fed75064d31 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Created volume successfully. Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Flow 'volume_create_manager' (f19ca769-df06-4437-a2a8-fec725ab5f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07a1f34-ebed-41cc-b86b-4d4892d3ef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07a1f34-ebed-41cc-b86b-4d4892d3ef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1684502305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972b4977-95bf-4d22-8d2f-faaa783ba9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6720d4068442e3b5f68b5a0d496945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:15Z,use_quota=True,user_id='eb6367200fdf4d92a402a5283c6a8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6026f36-ec0b-4306-b45a-64d7d41a5d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6026f36-ec0b-4306-b45a-64d7d41a5d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0bd45b-6d27-4d88-8ad4-ae9ec9dfe1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0bd45b-6d27-4d88-8ad4-ae9ec9dfe1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '972b4977-95bf-4d22-8d2f-faaa783ba9ee', 'volume_name': 'volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61e7654-edc0-43e3-adf6-60b27b678e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61e7654-edc0-43e3-adf6-60b27b678e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77855f81-b010-49b1-b2b5-8acb1de8c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:15 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Volume 972b4977-95bf-4d22-8d2f-faaa783ba9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee', 'volume_size': 1} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1684502305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972b4977-95bf-4d22-8d2f-faaa783ba9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc6720d4068442e3b5f68b5a0d496945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:15Z,use_quota=True,user_id='eb6367200fdf4d92a402a5283c6a8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Creating volume 972b4977-95bf-4d22-8d2f-faaa783ba9ee {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:24:15 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:15 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee 1073741824 Sep 30 10:24:15 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Acquiring lock "cinder-2ea293a9-e6cb-4d82-9753-471fd7ba720e-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Lock "cinder-2ea293a9-e6cb-4d82-9753-471fd7ba720e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Acquiring lock "cinder-quobyte-2ea293a9-e6cb-4d82-9753-471fd7ba720e" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Lock "cinder-quobyte-2ea293a9-e6cb-4d82-9753-471fd7ba720e" acquired by "delete_volume" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:24:15 devstack cinder-volume[87013]: INFO oslo.privsep.daemon [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_de3yk2q/privsep.sock'] Sep 30 10:24:15 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_de3yk2q/privsep.sock Sep 30 10:24:15 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:15 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee 1073741824" returned: 0 in 0.769s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:16 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee Sep 30 10:24:16 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:16 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee" returned: 0 in 0.259s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77855f81-b010-49b1-b2b5-8acb1de8c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95cf800-3383-4b66-88bd-d649a7794af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:16 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Volume volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee (972b4977-95bf-4d22-8d2f-faaa783ba9ee): created successfully Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95cf800-3383-4b66-88bd-d649a7794af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Flow 'volume_create_manager' (f19ca769-df06-4437-a2a8-fec725ab5f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:16 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-cd8b4543-1319-4f5b-acd7-db98dbde328a tempest-VolumesAdminNegativeTest-1437673394 None] Created volume successfully. Sep 30 10:24:16 devstack cinder-volume[87013]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 30 10:24:16 devstack cinder-volume[87013]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 10:24:16 devstack cinder-volume[87013]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 30 10:24:16 devstack cinder-volume[87013]: WARNING oslo.privsep.daemon [-] privsep log: Sep 30 10:24:16 devstack cinder-volume[87013]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 30 10:24:16 devstack cinder-volume[87013]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 30 10:24:16 devstack cinder-volume[87013]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 10:24:16 devstack cinder-volume[87013]: WARNING oslo.privsep.daemon [-] privsep log: Sep 30 10:24:16 devstack cinder-volume[87013]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 30 10:24:16 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:16 devstack cinder-volume[87013]: INFO oslo.privsep.daemon [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Spawned new privsep daemon via rootwrap Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Accepted privsep connection to /tmp/tmp_de3yk2q/privsep.sock {{(pid=87013) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 30 10:24:16 devstack cinder-volume[87013]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 30 10:24:16 devstack cinder-volume[87013]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 30 10:24:16 devstack cinder-volume[87013]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 30 10:24:16 devstack cinder-volume[87013]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88165 Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9397dc-4a07-4fec-801c-0b959c60426b]: (2,) {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[29062b1d-c4bc-4101-9196-c959b88eb679]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:24:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:16 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e Sep 30 10:24:16 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:17 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e" returned: 0 in 0.453s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:17 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e Sep 30 10:24:17 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Acquiring lock "cinder-972b4977-95bf-4d22-8d2f-faaa783ba9ee-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Lock "cinder-972b4977-95bf-4d22-8d2f-faaa783ba9ee-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Acquiring lock "cinder-quobyte-972b4977-95bf-4d22-8d2f-faaa783ba9ee" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Lock "cinder-quobyte-972b4977-95bf-4d22-8d2f-faaa783ba9ee" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a0f8d1-3e5d-4323-97a6-097105aeb563]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:17 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ea293a9-e6cb-4d82-9753-471fd7ba720e" returned: 0 in 0.417s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Lock "cinder-quobyte-2ea293a9-e6cb-4d82-9753-471fd7ba720e" released by "delete_volume" :: held 2.299s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:24:17 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee Sep 30 10:24:17 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:17 devstack cinder-volume[87013]: WARNING cinder.quota [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:24:17 devstack cinder-volume[87013]: WARNING cinder.quota [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Created reservations ['1db8ab51-b999-47f7-ac14-641a3b45b167', 'b869d823-5c0e-4753-9b33-946c0a64d9c5', 'dd877d63-7e37-4d49-9f77-413f8c79a03e', '585fa1b0-a3b7-48e5-9766-3c10f0b67a7c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:17 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:24:17 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:18 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee" returned: 0 in 0.510s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:18 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee Sep 30 10:24:18 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:18 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.316s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:24:18 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Deleted volume successfully. Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aff3c856-2d74-4b25-9227-bf90fb053ae0 tempest-VolumeQuotasNegativeTestJSON-1874587364 None] Lock "cinder-2ea293a9-e6cb-4d82-9753-471fd7ba720e-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:24:18 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-972b4977-95bf-4d22-8d2f-faaa783ba9ee" returned: 0 in 0.289s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Lock "cinder-quobyte-972b4977-95bf-4d22-8d2f-faaa783ba9ee" released by "delete_volume" :: held 0.905s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Created reservations ['5e5b9451-f1e3-4d9f-8d77-c1e40bb168d7', '40acf198-b684-4de8-8f62-1f109aa9cd2c', '17e1ec92-3558-4033-9b77-b38ca2b70471', 'c494f912-b57e-4956-bc88-505dda81fe74'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:18 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:24:18 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:18 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.406s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:18 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:24:19 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Deleted volume successfully. Sep 30 10:24:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d29e76fe-375d-41ac-be51-858e281f622d tempest-VolumesAdminNegativeTest-1437673394 None] Lock "cinder-972b4977-95bf-4d22-8d2f-faaa783ba9ee-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:24:28 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=20,cinder:SELECT=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:24:29 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=11,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:24:30 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:24:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Flow 'volume_create_manager' (8a7ead54-2158-4d05-824c-8d8a3b5b4da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d092d13b-bcee-4d14-93b2-27190de2b11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d092d13b-bcee-4d14-93b2-27190de2b11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1581903274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982a13ee-26ee-4ee2-88d5-d1c1345e8c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143930b9812a4011bb3b9b084f5b110e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:31Z,use_quota=True,user_id='2987fd5df7484efa91ba7a059649d468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(591c1d83-7880-4e4b-aa24-e9c40cd35e00),volume_type_id=591c1d83-7880-4e4b-aa24-e9c40cd35e00)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5301d6a5-0835-4b35-815f-d6b7517ffb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5301d6a5-0835-4b35-815f-d6b7517ffb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdebbc2-0392-4161-8579-edb2ac48fbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdebbc2-0392-4161-8579-edb2ac48fbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982a13ee-26ee-4ee2-88d5-d1c1345e8c41', 'volume_name': 'volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9596ae31-a9e5-44a4-9888-11610285e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9596ae31-a9e5-44a4-9888-11610285e829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c2133e-d673-46ee-b07d-0b2fe2b2ec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Volume 982a13ee-26ee-4ee2-88d5-d1c1345e8c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41', 'volume_size': 1} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1581903274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982a13ee-26ee-4ee2-88d5-d1c1345e8c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143930b9812a4011bb3b9b084f5b110e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:31Z,use_quota=True,user_id='2987fd5df7484efa91ba7a059649d468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(591c1d83-7880-4e4b-aa24-e9c40cd35e00),volume_type_id=591c1d83-7880-4e4b-aa24-e9c40cd35e00)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Creating volume 982a13ee-26ee-4ee2-88d5-d1c1345e8c41 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:24:31 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:31 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41 1073741824 Sep 30 10:24:31 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:31 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41 1073741824" returned: 0 in 0.774s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:31 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41 Sep 30 10:24:31 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:24:32 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Flow 'volume_create_manager' (5123b192-b34f-4092-8404-1ae4cdd1dfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8861cb4-5676-4599-9c80-2641b4564ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41" returned: 0 in 0.428s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8861cb4-5676-4599-9c80-2641b4564ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-857671111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43094020-fb4a-40bd-b9b4-82c197459384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d94e389e4334c648d189d3afcfb22a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:32Z,use_quota=True,user_id='411037e8da24488e98d293b2262e049a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba644666-f338-45a1-a8c3-4a75bf2f68b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba644666-f338-45a1-a8c3-4a75bf2f68b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0652016-8a92-4c8f-9536-f68f239a19b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0652016-8a92-4c8f-9536-f68f239a19b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43094020-fb4a-40bd-b9b4-82c197459384', 'volume_name': 'volume-43094020-fb4a-40bd-b9b4-82c197459384', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e80213-ad6a-455a-adfe-68e2748206d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e80213-ad6a-455a-adfe-68e2748206d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01ca676-6e6c-46ae-aa29-51ad6698fd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Volume 43094020-fb4a-40bd-b9b4-82c197459384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43094020-fb4a-40bd-b9b4-82c197459384', 'volume_size': 1} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-857671111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43094020-fb4a-40bd-b9b4-82c197459384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d94e389e4334c648d189d3afcfb22a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:32Z,use_quota=True,user_id='411037e8da24488e98d293b2262e049a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Creating volume 43094020-fb4a-40bd-b9b4-82c197459384 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:24:32 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c2133e-d673-46ee-b07d-0b2fe2b2ec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:32 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384 1073741824 Sep 30 10:24:32 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9746d942-8ece-4a09-9dcc-4b0ce569c448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Volume volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41 (982a13ee-26ee-4ee2-88d5-d1c1345e8c41): created successfully Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9746d942-8ece-4a09-9dcc-4b0ce569c448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Flow 'volume_create_manager' (8a7ead54-2158-4d05-824c-8d8a3b5b4da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-515121eb-e8fa-4610-b23c-e13e6bb50947 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Created volume successfully. Sep 30 10:24:33 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384 1073741824" returned: 0 in 0.720s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:33 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384 Sep 30 10:24:33 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:33 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384" returned: 0 in 0.356s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01ca676-6e6c-46ae-aa29-51ad6698fd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43094020-fb4a-40bd-b9b4-82c197459384', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6048b3-778d-4e6d-91e9-606834dd3e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:33 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Volume volume-43094020-fb4a-40bd-b9b4-82c197459384 (43094020-fb4a-40bd-b9b4-82c197459384): created successfully Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6048b3-778d-4e6d-91e9-606834dd3e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Flow 'volume_create_manager' (5123b192-b34f-4092-8404-1ae4cdd1dfbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:33 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-00c11389-87cd-4d0c-96ef-0b36cff85f4b tempest-AttachVolumeTestJSON-1730628854 None] Created volume successfully. Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2dcfece6-bbc8-4bca-bab2-7c7cc4bff661 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2dcfece6-bbc8-4bca-bab2-7c7cc4bff661 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfece6-bbc8-4bca-bab2-7c7cc4bff661 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfece6-bbc8-4bca-bab2-7c7cc4bff661 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2dcfece6-bbc8-4bca-bab2-7c7cc4bff661 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2dcfece6-bbc8-4bca-bab2-7c7cc4bff661 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:33 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:24:33 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:34 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2dcfece6-bbc8-4bca-bab2-7c7cc4bff661 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.350s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:34 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-2dcfece6-bbc8-4bca-bab2-7c7cc4bff661 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:24:34 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2dcfece6-bbc8-4bca-bab2-7c7cc4bff661 tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Retype volume completed successfully. Sep 30 10:24:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Acquiring lock "cinder-982a13ee-26ee-4ee2-88d5-d1c1345e8c41-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:24:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "cinder-982a13ee-26ee-4ee2-88d5-d1c1345e8c41-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:24:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Acquiring lock "cinder-quobyte-982a13ee-26ee-4ee2-88d5-d1c1345e8c41" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:24:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "cinder-quobyte-982a13ee-26ee-4ee2-88d5-d1c1345e8c41" acquired by "delete_volume" :: waited 0.062s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:24:35 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0528626e-fcb5-44f9-9ab8-a176d6c372fd]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:24:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:35 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41 Sep 30 10:24:35 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:35 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41" returned: 0 in 0.653s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:35 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41 Sep 30 10:24:35 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:36 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-982a13ee-26ee-4ee2-88d5-d1c1345e8c41" returned: 0 in 0.314s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "cinder-quobyte-982a13ee-26ee-4ee2-88d5-d1c1345e8c41" released by "delete_volume" :: held 1.040s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:24:36 devstack cinder-volume[87013]: WARNING cinder.quota [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:24:36 devstack cinder-volume[87013]: WARNING cinder.quota [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Created reservations ['5a4d9129-78a9-4ecd-b75c-5c6f075d0cdd', '72ff0343-1f46-4432-8f74-3b401ac5e3b4', '7c2bca2b-651c-4322-a7e0-9e9346222729', '01869bc7-6c8e-4d9d-bb38-99eee6109690'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:36 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:24:36 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:36 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.409s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:24:36 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Deleted volume successfully. Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67535cd5-d784-486d-ba46-3b8bc825180d tempest-VolumeRetypeWithoutMigrationTest-56126638 None] Lock "cinder-982a13ee-26ee-4ee2-88d5-d1c1345e8c41-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:24:36 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:37 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:24:37 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:37 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.480s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 8 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:24:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:24:38 devstack cinder-volume[87013]: WARNING py.warnings [req-1ec23549-83ba-4364-8de2-bfe85f774184 req-b71c032d-714d-4bd8-bf7a-f773294952e9 tempest-AttachVolumeTestJSON-1730628854 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 30 10:24:38 devstack cinder-volume[87013]: .first() Sep 30 10:24:38 devstack cinder-volume[87013]: Sep 30 10:24:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-1ec23549-83ba-4364-8de2-bfe85f774184 req-b71c032d-714d-4bd8-bf7a-f773294952e9 tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-1ec23549-83ba-4364-8de2-bfe85f774184 req-b71c032d-714d-4bd8-bf7a-f773294952e9 tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-1ec23549-83ba-4364-8de2-bfe85f774184 req-b71c032d-714d-4bd8-bf7a-f773294952e9 tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-1ec23549-83ba-4364-8de2-bfe85f774184 req-b71c032d-714d-4bd8-bf7a-f773294952e9 tempest-AttachVolumeTestJSON-1730628854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-43094020-fb4a-40bd-b9b4-82c197459384', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da221914-e7cc-472e-a38f-a63729c18010', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:24:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-1ec23549-83ba-4364-8de2-bfe85f774184 req-b71c032d-714d-4bd8-bf7a-f773294952e9 tempest-AttachVolumeTestJSON-1730628854 None] attachment_update completed successfully. Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Flow 'volume_create_manager' (ddc408d3-a57a-43c0-a106-fcc105eaff90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096678a6-faad-4e8b-8b72-2020dfc09ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096678a6-faad-4e8b-8b72-2020dfc09ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1504878287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b01e45-1377-4446-b74a-647648efedca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1b544c6afc4dda835c187927b2297b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:43Z,use_quota=True,user_id='3871b1c556394fe49be03a8a8a37b0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb71ba68-007d-4dce-a4f8-d16a83c69de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb71ba68-007d-4dce-a4f8-d16a83c69de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956e9f14-6d52-484f-8fb4-90f6f5c0a508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956e9f14-6d52-484f-8fb4-90f6f5c0a508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b01e45-1377-4446-b74a-647648efedca', 'volume_name': 'volume-e7b01e45-1377-4446-b74a-647648efedca', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fe0e8e-6558-43a2-ad78-c49744640984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fe0e8e-6558-43a2-ad78-c49744640984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d64383-a32c-4511-9fdc-503be0ec0b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:43 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Volume e7b01e45-1377-4446-b74a-647648efedca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b01e45-1377-4446-b74a-647648efedca', 'volume_size': 1} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1504878287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b01e45-1377-4446-b74a-647648efedca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1b544c6afc4dda835c187927b2297b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:43Z,use_quota=True,user_id='3871b1c556394fe49be03a8a8a37b0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Creating volume e7b01e45-1377-4446-b74a-647648efedca {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:24:43 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:24:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:43 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca 1073741824 Sep 30 10:24:43 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:44 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca 1073741824" returned: 0 in 0.863s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:44 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca Sep 30 10:24:44 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:44 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca" returned: 0 in 0.438s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:24:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d64383-a32c-4511-9fdc-503be0ec0b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b01e45-1377-4446-b74a-647648efedca', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fc33f2-6a8d-42d7-a40c-46255c254d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:44 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Volume volume-e7b01e45-1377-4446-b74a-647648efedca (e7b01e45-1377-4446-b74a-647648efedca): created successfully Sep 30 10:24:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fc33f2-6a8d-42d7-a40c-46255c254d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Flow 'volume_create_manager' (ddc408d3-a57a-43c0-a106-fcc105eaff90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-314fb084-42e2-4521-8bdb-ab8e3c27d5ba tempest-DeleteServersTestJSON-1030015496 None] Created volume successfully. Sep 30 10:24:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-ca7d9ebf-5b56-42e7-9857-3457dc106c24 req-6158e708-6d8f-4261-81e2-353ac87ece1f tempest-DeleteServersTestJSON-1030015496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-ca7d9ebf-5b56-42e7-9857-3457dc106c24 req-6158e708-6d8f-4261-81e2-353ac87ece1f tempest-DeleteServersTestJSON-1030015496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-ca7d9ebf-5b56-42e7-9857-3457dc106c24 req-6158e708-6d8f-4261-81e2-353ac87ece1f tempest-DeleteServersTestJSON-1030015496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-ca7d9ebf-5b56-42e7-9857-3457dc106c24 req-6158e708-6d8f-4261-81e2-353ac87ece1f tempest-DeleteServersTestJSON-1030015496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-e7b01e45-1377-4446-b74a-647648efedca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebd3059a-9f92-4ae4-a15b-0f7caed03c90', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:24:48 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-ca7d9ebf-5b56-42e7-9857-3457dc106c24 req-6158e708-6d8f-4261-81e2-353ac87ece1f tempest-DeleteServersTestJSON-1030015496 None] attachment_update completed successfully. Sep 30 10:24:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-f76231d8-c377-40a6-b979-585c73da4740 req-3d61dd22-9aee-4ee6-9edd-f5485b874353 tempest-DeleteServersTestJSON-1030015496 None] Terminate volume connection completed successfully. Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-f76231d8-c377-40a6-b979-585c73da4740 req-3d61dd22-9aee-4ee6-9edd-f5485b874353 tempest-DeleteServersTestJSON-1030015496 None] Deleting attachment ebd3059a-9f92-4ae4-a15b-0f7caed03c90. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Flow 'volume_create_manager' (177f043f-8ed6-40bc-95c4-650c2de60120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b4a3d8-a377-42ea-bad3-156110259914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b4a3d8-a377-42ea-bad3-156110259914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-903041400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4384f4d5-06da-43ee-8ac8-bed0ca2b0409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ddad65991d474d8a7085806ea17136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:56Z,use_quota=True,user_id='376d0d3439d246b9b9f2b9bfbcfd83d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b79c38d-3477-46fa-bdf9-e6f5210f48bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b79c38d-3477-46fa-bdf9-e6f5210f48bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467b2e61-4c78-47df-a111-6b350d148543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467b2e61-4c78-47df-a111-6b350d148543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4384f4d5-06da-43ee-8ac8-bed0ca2b0409', 'volume_name': 'volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b04ce35-f185-49a2-adf4-7aa8afc7413b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b04ce35-f185-49a2-adf4-7aa8afc7413b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa70ee81-abb4-4453-8860-aff32c25d2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:55 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Volume 4384f4d5-06da-43ee-8ac8-bed0ca2b0409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409', 'volume_size': 1} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-903041400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4384f4d5-06da-43ee-8ac8-bed0ca2b0409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ddad65991d474d8a7085806ea17136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:24:56Z,use_quota=True,user_id='376d0d3439d246b9b9f2b9bfbcfd83d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Creating volume 4384f4d5-06da-43ee-8ac8-bed0ca2b0409 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:24:55 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:24:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:55 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 1073741824 Sep 30 10:24:55 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:56 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 1073741824" returned: 0 in 0.672s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Acquiring lock "cinder-e7b01e45-1377-4446-b74a-647648efedca-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:24:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Lock "cinder-e7b01e45-1377-4446-b74a-647648efedca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:24:56 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 Sep 30 10:24:56 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Acquiring lock "cinder-quobyte-e7b01e45-1377-4446-b74a-647648efedca" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:24:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Lock "cinder-quobyte-e7b01e45-1377-4446-b74a-647648efedca" acquired by "delete_volume" :: waited 0.036s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:24:56 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db2812-708d-4893-9ffc-c7eb0eecc4c3]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:24:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:56 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca Sep 30 10:24:56 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:56 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" returned: 0 in 0.343s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa70ee81-abb4-4453-8860-aff32c25d2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b635434-65f6-4aef-a413-668f6ee9bbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:24:57 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Volume volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 (4384f4d5-06da-43ee-8ac8-bed0ca2b0409): created successfully Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b635434-65f6-4aef-a413-668f6ee9bbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Flow 'volume_create_manager' (177f043f-8ed6-40bc-95c4-650c2de60120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:24:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-d5befe26-ae37-43f1-accf-beb24bc4e360 req-7729f2f5-f7c3-4bb7-b320-1a15d0292c78 tempest-VolumesSnapshotsTestJSON-1307500049 None] Created volume successfully. Sep 30 10:24:57 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca" returned: 0 in 0.495s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:57 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca Sep 30 10:24:57 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:57 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e7b01e45-1377-4446-b74a-647648efedca" returned: 0 in 0.342s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Lock "cinder-quobyte-e7b01e45-1377-4446-b74a-647648efedca" released by "delete_volume" :: held 0.910s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Created reservations ['35d70d2d-8b95-445a-8266-7bef0344b199', '30472531-d917-4e18-b912-7061f623a383', '60112b29-a13d-42ae-8563-2f4678e1da09', '08836981-cd8d-4682-8dc2-4f4832f436d3'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:24:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:57 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:24:57 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:58 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.445s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:58 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:24:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Deleted volume successfully. Sep 30 10:24:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d0f14926-7e50-44ba-81dd-d762713a4b09 tempest-DeleteServersTestJSON-1030015496 None] Lock "cinder-e7b01e45-1377-4446-b74a-647648efedca-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:24:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:24:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:24:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Creating offline snapshot 39692027-b24b-4707-8a14-2c5515015149 of volume 4384f4d5-06da-43ee-8ac8-bed0ca2b0409 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:24:58 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7965da8-6be0-4270-96bc-5f16df87e21d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:24:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:58 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 Sep 30 10:24:58 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:59 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" returned: 0 in 0.451s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:59 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 1G Sep 30 10:24:59 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:24:59 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Sep 30 10:24:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 1G" returned: 0 in 0.546s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:24:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:24:59 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 Sep 30 10:24:59 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:00 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149" returned: 0 in 0.486s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:00 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 is being set with open permissions: ugo+rw Sep 30 10:25:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:00 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 Sep 30 10:25:00 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:00 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149" returned: 0 in 0.354s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:00 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.info Sep 30 10:25:00 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:00 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.info" returned: 0 in 0.309s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:00 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.info is being set with open permissions: ugo+rw Sep 30 10:25:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:00 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.info Sep 30 10:25:00 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:01 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.info" returned: 0 in 0.381s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:01 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-9bfa74bc-5683-4aa3-955f-a1e11f275fb1 req-ac38670d-d582-494f-959e-5b2a20275162 tempest-VolumesSnapshotsTestJSON-1307500049 None] Create snapshot completed successfully Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Acquiring lock "cinder-39692027-b24b-4707-8a14-2c5515015149-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "cinder-39692027-b24b-4707-8a14-2c5515015149-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Acquiring lock "cinder-quobyte-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "cinder-quobyte-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Acquiring lock "cinder-quobyte-39692027-b24b-4707-8a14-2c5515015149" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "cinder-quobyte-39692027-b24b-4707-8a14-2c5515015149" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Deleting offline snapshot 39692027-b24b-4707-8a14-2c5515015149 of volume 4384f4d5-06da-43ee-8ac8-bed0ca2b0409 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] snapshot_file for this snap is: volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2522af71-be79-4da1-9dac-1bd7a4821592]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:01 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 Sep 30 10:25:01 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:02 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149" returned: 0 in 0.556s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:25:02 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c23287-d088-4f6f-9da1-a518676a4ebc]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:02 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 Sep 30 10:25:02 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:03 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" returned: 0 in 0.729s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:03 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 Sep 30 10:25:03 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:03 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149" returned: 0 in 0.624s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:03 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149 Sep 30 10:25:03 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:04 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409.39692027-b24b-4707-8a14-2c5515015149" returned: 0 in 0.377s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "cinder-quobyte-39692027-b24b-4707-8a14-2c5515015149" released by "_delete_snapshot" :: held 2.484s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "cinder-quobyte-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" released by "delete_snapshot" :: held 2.555s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:04 devstack cinder-volume[87013]: WARNING cinder.quota [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:25:04 devstack cinder-volume[87013]: DEBUG cinder.quota [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Created reservations ['d2e14497-308f-44c9-bdc4-d1c2459190ff', '1398cee7-e00e-47e8-998a-de5eaac72487', '32cb9f60-09cf-407e-92b4-d13985019bfd', '44dea2df-9f6c-4100-b402-23fa4f558d0d'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:25:04 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Delete snapshot completed successfully. Sep 30 10:25:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-3a93ad08-658d-4296-9112-79328b9481d1 req-2bc852f0-8bbf-4344-85c6-44aabe6f6fd1 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "cinder-39692027-b24b-4707-8a14-2c5515015149-delete_snapshot" released by "delete_snapshot" :: held 2.775s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Acquiring lock "cinder-4384f4d5-06da-43ee-8ac8-bed0ca2b0409-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "cinder-4384f4d5-06da-43ee-8ac8-bed0ca2b0409-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Acquiring lock "cinder-quobyte-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "cinder-quobyte-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" acquired by "delete_volume" :: waited 0.037s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80410e2-6487-429c-87c8-f4aaafca4986]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:05 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 Sep 30 10:25:05 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:06 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" returned: 0 in 0.767s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:06 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409 Sep 30 10:25:06 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:06 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" returned: 0 in 0.344s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "cinder-quobyte-4384f4d5-06da-43ee-8ac8-bed0ca2b0409" released by "delete_volume" :: held 1.256s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG cinder.quota [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Created reservations ['eadd4390-5801-4794-beb4-8852e372327c', 'e3c839b9-3c42-4d36-8cd0-7e9f1b1e6e31', '08f94094-4666-4b6e-a42e-d3ba04716738', '4cd40cf3-571b-4f5d-8903-4f0f48e9a4e2'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:06 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:25:06 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:07 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.356s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:07 devstack cinder-volume[87013]: DEBUG cinder.manager [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:25:07 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Deleted volume successfully. Sep 30 10:25:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-f2b7e70c-b001-4429-bf10-59e844e51f56 req-72522320-ddc7-424c-87ab-2f97f2a3ae01 tempest-VolumesSnapshotsTestJSON-1307500049 None] Lock "cinder-4384f4d5-06da-43ee-8ac8-bed0ca2b0409-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Flow 'volume_create_manager' (a6c89c5e-021e-40d6-ba88-97c87257006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c53785a-b56c-47e1-8645-a183a2392222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c53785a-b56c-47e1-8645-a183a2392222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-705193467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e31b0d-f0f6-474a-9bae-812cd10ebd5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a85e3ce976f9456cb67db671a44e7e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:12Z,use_quota=True,user_id='0c319e39976546e4b2f9f8b921fdbae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25956f47-d2f9-4e6b-ba41-51a8e77d833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25956f47-d2f9-4e6b-ba41-51a8e77d833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271648e4-6d7c-41cc-bff0-5eebc2c442e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271648e4-6d7c-41cc-bff0-5eebc2c442e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e31b0d-f0f6-474a-9bae-812cd10ebd5c', 'volume_name': 'volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261dbff5-2e82-44fa-91b2-018c5321620f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261dbff5-2e82-44fa-91b2-018c5321620f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f27549f-c67c-4169-8465-3c435580a1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:12 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Volume 48e31b0d-f0f6-474a-9bae-812cd10ebd5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c', 'volume_size': 1} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-705193467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e31b0d-f0f6-474a-9bae-812cd10ebd5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a85e3ce976f9456cb67db671a44e7e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:12Z,use_quota=True,user_id='0c319e39976546e4b2f9f8b921fdbae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Creating volume 48e31b0d-f0f6-474a-9bae-812cd10ebd5c {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:25:12 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:25:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:12 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c 1073741824 Sep 30 10:25:12 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:13 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c 1073741824" returned: 0 in 0.601s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:13 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c Sep 30 10:25:13 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:13 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c" returned: 0 in 0.279s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:25:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f27549f-c67c-4169-8465-3c435580a1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8390a5-43e4-42ab-a429-0efcb491d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:13 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Volume volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c (48e31b0d-f0f6-474a-9bae-812cd10ebd5c): created successfully Sep 30 10:25:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8390a5-43e4-42ab-a429-0efcb491d40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Flow 'volume_create_manager' (a6c89c5e-021e-40d6-ba88-97c87257006e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:13 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-6e53d5ea-efb8-4a7d-a77c-e42852aec1c3 req-023b2ed8-dc52-4242-81c9-d2d895d3b3f3 tempest-VolumesGetTestJSON-1955147566 None] Created volume successfully. Sep 30 10:25:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Acquiring lock "cinder-48e31b0d-f0f6-474a-9bae-812cd10ebd5c-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Lock "cinder-48e31b0d-f0f6-474a-9bae-812cd10ebd5c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Acquiring lock "cinder-quobyte-48e31b0d-f0f6-474a-9bae-812cd10ebd5c" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Lock "cinder-quobyte-48e31b0d-f0f6-474a-9bae-812cd10ebd5c" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:14 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2c95e0-aac0-4571-bb82-b012ddeaa4e4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:15 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c Sep 30 10:25:15 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:15 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c" returned: 0 in 0.447s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:15 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c Sep 30 10:25:15 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:15 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-48e31b0d-f0f6-474a-9bae-812cd10ebd5c" returned: 0 in 0.322s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Lock "cinder-quobyte-48e31b0d-f0f6-474a-9bae-812cd10ebd5c" released by "delete_volume" :: held 0.840s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG cinder.quota [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Created reservations ['1ef1cfb4-5f22-4397-a665-e10a5e6f3b80', '18efdad0-a2ac-425d-b6a6-75cc76aa0f20', '5edd170b-dab1-4c12-bd96-332e2f6a01b4', 'e136094e-415d-4c13-89e5-4de0ad3874f5'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:15 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:25:15 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:16 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.357s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:16 devstack cinder-volume[87013]: DEBUG cinder.manager [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:25:16 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Deleted volume successfully. Sep 30 10:25:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-47578493-eecc-41de-a05e-9579366a692a req-93662f3d-edff-4e4c-923c-5e0ac0e17350 tempest-VolumesGetTestJSON-1955147566 None] Lock "cinder-48e31b0d-f0f6-474a-9bae-812cd10ebd5c-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-dc94aea9-f267-4e0c-a052-6fed44d5acbf req-1bdfd8cb-ca17-49ff-abc6-e7f71ccadf0a tempest-AttachVolumeTestJSON-1730628854 None] Terminate volume connection completed successfully. Sep 30 10:25:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-dc94aea9-f267-4e0c-a052-6fed44d5acbf req-1bdfd8cb-ca17-49ff-abc6-e7f71ccadf0a tempest-AttachVolumeTestJSON-1730628854 None] Deleting attachment da221914-e7cc-472e-a38f-a63729c18010. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:25:25 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-00a5a338-1fbb-4530-ba0b-9ae28757bf1e tempest-GroupSnapshotsTest-2146078764 None] Group tempest-GroupSnapshotsTest-Group-1582231344: creating Sep 30 10:25:25 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-00a5a338-1fbb-4530-ba0b-9ae28757bf1e tempest-GroupSnapshotsTest-2146078764 None] Group tempest-GroupSnapshotsTest-Group-1582231344: created successfully Sep 30 10:25:26 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-00a5a338-1fbb-4530-ba0b-9ae28757bf1e tempest-GroupSnapshotsTest-2146078764 None] Create group completed successfully. Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Flow 'volume_create_manager' (40106dbb-ad5e-4bb5-9898-648a2d9ab1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba2986f-5675-4640-b93c-58322fc32d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba2986f-5675-4640-b93c-58322fc32d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-856129445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1cad68a4-5f56-4f90-9420-e65747e60ed0,host='devstack@QuobyteHD#QuobyteHD',id=508dce1f-3456-4408-8fb5-a65c87567bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3183af47c9e24d7e966a500f2dc1d7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:28Z,use_quota=True,user_id='c7807657f3e84e3ca8eeef763c850a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa263c97-6b2d-4872-a604-506404095a84),volume_type_id=aa263c97-6b2d-4872-a604-506404095a84)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca2db05-2798-4bb2-b3a4-e19f9287e9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca2db05-2798-4bb2-b3a4-e19f9287e9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9aac0a-320e-45ad-8cb8-36fe7301b416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9aac0a-320e-45ad-8cb8-36fe7301b416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '508dce1f-3456-4408-8fb5-a65c87567bc2', 'volume_name': 'volume-508dce1f-3456-4408-8fb5-a65c87567bc2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47d768c-de42-4865-90eb-759a89c87b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47d768c-de42-4865-90eb-759a89c87b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c81357-4c06-4638-9b1d-5117568a182b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:27 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Volume 508dce1f-3456-4408-8fb5-a65c87567bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-508dce1f-3456-4408-8fb5-a65c87567bc2', 'volume_size': 1} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1cad68a4-5f56-4f90-9420-e65747e60ed0,created_at=2026-09-30T08:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-856129445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1cad68a4-5f56-4f90-9420-e65747e60ed0,host='devstack@QuobyteHD#QuobyteHD',id=508dce1f-3456-4408-8fb5-a65c87567bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3183af47c9e24d7e966a500f2dc1d7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:28Z,use_quota=True,user_id='c7807657f3e84e3ca8eeef763c850a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa263c97-6b2d-4872-a604-506404095a84),volume_type_id=aa263c97-6b2d-4872-a604-506404095a84)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Creating volume 508dce1f-3456-4408-8fb5-a65c87567bc2 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:25:27 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:25:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:27 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 1073741824 Sep 30 10:25:27 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:28 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 1073741824" returned: 0 in 0.669s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:28 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 Sep 30 10:25:28 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:29 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2" returned: 0 in 0.543s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:25:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:29 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=66,cinder:UPDATE=68,cinder:INSERT=13,cinder:DELETE=7 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:25:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c81357-4c06-4638-9b1d-5117568a182b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-508dce1f-3456-4408-8fb5-a65c87567bc2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddbb001-09db-49d4-910d-dbcbf25c34f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:29 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=63,cinder:SELECT=64,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:25:29 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Volume volume-508dce1f-3456-4408-8fb5-a65c87567bc2 (508dce1f-3456-4408-8fb5-a65c87567bc2): created successfully Sep 30 10:25:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddbb001-09db-49d4-910d-dbcbf25c34f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Flow 'volume_create_manager' (40106dbb-ad5e-4bb5-9898-648a2d9ab1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:29 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8f42042f-d572-4e41-a861-e35c5145fd9f tempest-GroupSnapshotsTest-2146078764 None] Created volume successfully. Sep 30 10:25:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] GroupSnapshot fee33b3f-6bf3-4c31-b06a-cde4085a73bc: creating. Sep 30 10:25:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Group snapshot fee33b3f-6bf3-4c31-b06a-cde4085a73bc: creating. {{(pid=87013) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 10:25:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Creating offline snapshot 904ff73c-0507-48bd-886c-975da75d33e5 of volume 508dce1f-3456-4408-8fb5-a65c87567bc2 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:25:30 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[519fb7d9-6a62-4402-8cf5-73afb0d19bec]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:31 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 Sep 30 10:25:31 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:31 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2" returned: 0 in 0.609s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:31 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 1G Sep 30 10:25:31 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:32 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 1G" returned: 0 in 0.746s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-508dce1f-3456-4408-8fb5-a65c87567bc2 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:32 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-508dce1f-3456-4408-8fb5-a65c87567bc2 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 Sep 30 10:25:32 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:32 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-508dce1f-3456-4408-8fb5-a65c87567bc2 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5" returned: 0 in 0.432s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:32 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:25:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:32 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 Sep 30 10:25:32 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:33 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5" returned: 0 in 0.478s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:33 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.info Sep 30 10:25:33 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:33 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.info" returned: 0 in 0.561s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:33 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:25:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:33 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.info Sep 30 10:25:33 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:34 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.info" returned: 0 in 0.790s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.846s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:34 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ef997c46-0f93-40be-82cd-cbeb8738bc76 tempest-GroupSnapshotsTest-2146078764 None] group_snapshot fee33b3f-6bf3-4c31-b06a-cde4085a73bc: created successfully Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (504de6f0-39a1-4a10-8828-eb8acbe25a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4580233-6c70-4241-90bf-acef0a233e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4580233-6c70-4241-90bf-acef0a233e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1682060745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1256ce-2adc-449b-95ba-5835421f54c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:36Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9482d21-d8f7-4d66-9061-a284fa9cf406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9482d21-d8f7-4d66-9061-a284fa9cf406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22c61d1-c8f9-4895-8b32-8a3eacd932be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22c61d1-c8f9-4895-8b32-8a3eacd932be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1256ce-2adc-449b-95ba-5835421f54c1', 'volume_name': 'volume-4d1256ce-2adc-449b-95ba-5835421f54c1', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b232dcb-8752-48d1-9aca-de67098ee450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b232dcb-8752-48d1-9aca-de67098ee450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09664270-4eb2-4fce-b38e-15d8f09a5e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:36 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Volume 4d1256ce-2adc-449b-95ba-5835421f54c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1256ce-2adc-449b-95ba-5835421f54c1', 'volume_size': 1} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1682060745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1256ce-2adc-449b-95ba-5835421f54c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:36Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Creating volume 4d1256ce-2adc-449b-95ba-5835421f54c1 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:25:36 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:36 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1 1073741824 Sep 30 10:25:36 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:37 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:25:37 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:37 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1 1073741824" returned: 0 in 0.938s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:37 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1 Sep 30 10:25:37 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:37 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.593s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:25:37 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1" returned: 0 in 0.330s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.830s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-904ff73c-0507-48bd-886c-975da75d33e5-af038146-c7f8-4631-a82a-7e272933a940" by "_create_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09664270-4eb2-4fce-b38e-15d8f09a5e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1256ce-2adc-449b-95ba-5835421f54c1', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf29046-8a75-4688-a85b-74c17e2bea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-904ff73c-0507-48bd-886c-975da75d33e5-af038146-c7f8-4631-a82a-7e272933a940" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Creating volume af038146-c7f8-4631-a82a-7e272933a940 from snapshot 904ff73c-0507-48bd-886c-975da75d33e5 {{(pid=87013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-af038146-c7f8-4631-a82a-7e272933a940" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:37 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Volume volume-4d1256ce-2adc-449b-95ba-5835421f54c1 (4d1256ce-2adc-449b-95ba-5835421f54c1): created successfully Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf29046-8a75-4688-a85b-74c17e2bea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (504de6f0-39a1-4a10-8828-eb8acbe25a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:37 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-bb6b174a-9c0d-4f10-bf43-818893d2e87c tempest-VolumesActionsTest-1913964315 None] Created volume successfully. Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-af038146-c7f8-4631-a82a-7e272933a940" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] snapshot: 904ff73c-0507-48bd-886c-975da75d33e5, volume: af038146-c7f8-4631-a82a-7e272933a940, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b78da2a-47d4-412a-8329-ce63721f48b7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:38 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 Sep 30 10:25:38 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2d9cc224-317d-460b-b65d-789f68b389b5 tempest-VolumesActionsTest-1913964315 None] Acquiring lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1" by "attach_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2d9cc224-317d-460b-b65d-789f68b389b5 tempest-VolumesActionsTest-1913964315 None] Lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1" acquired by "attach_volume" :: waited 0.064s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:38 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5" returned: 0 in 0.591s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-508dce1f-3456-4408-8fb5-a65c87567bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:25:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2d9cc224-317d-460b-b65d-789f68b389b5 tempest-VolumesActionsTest-1913964315 None] Attaching volume 4d1256ce-2adc-449b-95ba-5835421f54c1 to instance a6e23740-2610-47bf-aea2-19f5a83d2d17 at mountpoint /dev/vdb on host None. Sep 30 10:25:38 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4273e522-3ef1-46c5-908b-8d1491ff8e65]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2d9cc224-317d-460b-b65d-789f68b389b5 tempest-VolumesActionsTest-1913964315 None] Attach volume completed successfully. Sep 30 10:25:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2d9cc224-317d-460b-b65d-789f68b389b5 tempest-VolumesActionsTest-1913964315 None] Lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1" released by "attach_volume" :: held 0.245s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:38 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 Sep 30 10:25:38 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:39 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2" returned: 0 in 0.680s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:25:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:25:39 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:25:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:39 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 Sep 30 10:25:39 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-1decd8c5-d73f-46f4-b52f-a8273065fa04 tempest-VolumesActionsTest-240722379 None] Terminate volume connection completed successfully. Sep 30 10:25:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1decd8c5-d73f-46f4-b52f-a8273065fa04 tempest-VolumesActionsTest-240722379 None] Acquiring lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1-detach_volume" by "detach_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1decd8c5-d73f-46f4-b52f-a8273065fa04 tempest-VolumesActionsTest-240722379 None] Lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-1decd8c5-d73f-46f4-b52f-a8273065fa04 tempest-VolumesActionsTest-240722379 None] Detaching volume 4d1256ce-2adc-449b-95ba-5835421f54c1 from instance a6e23740-2610-47bf-aea2-19f5a83d2d17. Sep 30 10:25:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-1decd8c5-d73f-46f4-b52f-a8273065fa04 tempest-VolumesActionsTest-240722379 None] Detach volume completed successfully. Sep 30 10:25:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1decd8c5-d73f-46f4-b52f-a8273065fa04 tempest-VolumesActionsTest-240722379 None] Lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1-detach_volume" released by "detach_volume" :: held 0.180s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01bded4f-323b-452a-a5c7-103d7a5c05e8 tempest-VolumesActionsTest-1913964315 None] Acquiring lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1-detach_volume" by "detach_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01bded4f-323b-452a-a5c7-103d7a5c05e8 tempest-VolumesActionsTest-1913964315 None] Lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-01bded4f-323b-452a-a5c7-103d7a5c05e8 tempest-VolumesActionsTest-1913964315 None] Volume detach called, but volume not attached. Sep 30 10:25:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01bded4f-323b-452a-a5c7-103d7a5c05e8 tempest-VolumesActionsTest-1913964315 None] Lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Acquiring lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Acquiring lock "cinder-quobyte-4d1256ce-2adc-449b-95ba-5835421f54c1" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Lock "cinder-quobyte-4d1256ce-2adc-449b-95ba-5835421f54c1" acquired by "delete_volume" :: waited 0.042s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:41 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5e4618-738d-4f43-b281-54534c2a5cdf]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:41 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1 Sep 30 10:25:41 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:42 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1" returned: 0 in 1.467s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:42 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1 Sep 30 10:25:42 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:44 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4d1256ce-2adc-449b-95ba-5835421f54c1" returned: 0 in 1.478s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Lock "cinder-quobyte-4d1256ce-2adc-449b-95ba-5835421f54c1" released by "delete_volume" :: held 3.122s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:44 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Created reservations ['2056b4ab-b8b7-4005-ab9d-584c6c9da5b4', '1083e153-f311-4fe5-9819-e179ab270263', '382868d7-0961-4fcd-ad05-f15c18bfc1f6', '26b814e8-b0ca-4b06-94e7-fa020e1cf643'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:25:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:45 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:25:45 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:46 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 1.253s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:46 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:25:46 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Deleted volume successfully. Sep 30 10:25:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d804882-e7d6-420c-ad9a-c6f369a8c7eb tempest-VolumesActionsTest-1913964315 None] Lock "cinder-4d1256ce-2adc-449b-95ba-5835421f54c1-delete_volume" released by "delete_volume" :: held 5.333s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:51 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940" returned: 0 in 11.783s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2, size 1024.00 MB, duration 11.79 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:25:51 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Converted 1024.00 MB image at 86.89 MB/s Sep 30 10:25:51 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:51 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 Sep 30 10:25:51 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:51 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940" returned: 0 in 0.332s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-af038146-c7f8-4631-a82a-7e272933a940" released by "_copy_volume_from_snapshot" :: held 13.549s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-904ff73c-0507-48bd-886c-975da75d33e5-af038146-c7f8-4631-a82a-7e272933a940" released by "_create_volume_from_snapshot" :: held 13.662s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.710s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:51 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d2667962-a385-49c5-8393-dc9dcb358a29 tempest-GroupSnapshotsTest-2146078764 None] Create group from source-snapshot-fee33b3f-6bf3-4c31-b06a-cde4085a73bc completed successfully. Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (fd437470-864a-412b-9af0-fe01e7613c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b22072-d4a0-4792-87fa-fb68f8c86b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b22072-d4a0-4792-87fa-fb68f8c86b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-999994955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a508e6f-3868-41ec-a8ab-096b69578e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:52Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aea69f1-f3f1-4740-84da-e56a212af8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aea69f1-f3f1-4740-84da-e56a212af8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02770f1d-5476-4bf0-935d-6f43fca79176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02770f1d-5476-4bf0-935d-6f43fca79176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a508e6f-3868-41ec-a8ab-096b69578e96', 'volume_name': 'volume-3a508e6f-3868-41ec-a8ab-096b69578e96', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5748a6-38a7-42e1-8e06-2f69a35793fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5748a6-38a7-42e1-8e06-2f69a35793fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e61bfd-34fb-4e76-9d70-6c28628c4ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:51 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Volume 3a508e6f-3868-41ec-a8ab-096b69578e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a508e6f-3868-41ec-a8ab-096b69578e96', 'volume_size': 1} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-999994955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a508e6f-3868-41ec-a8ab-096b69578e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:52Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Creating volume 3a508e6f-3868-41ec-a8ab-096b69578e96 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:25:51 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:25:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:51 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96 1073741824 Sep 30 10:25:51 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:52 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96 1073741824" returned: 0 in 0.500s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:52 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96 Sep 30 10:25:52 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:52 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96" returned: 0 in 0.293s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e61bfd-34fb-4e76-9d70-6c28628c4ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a508e6f-3868-41ec-a8ab-096b69578e96', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce75177b-94fd-49da-bfa7-d65b1e712dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:52 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Volume volume-3a508e6f-3868-41ec-a8ab-096b69578e96 (3a508e6f-3868-41ec-a8ab-096b69578e96): created successfully Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce75177b-94fd-49da-bfa7-d65b1e712dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (fd437470-864a-412b-9af0-fe01e7613c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d7010b33-1c40-4e25-aa91-389c2490eedd tempest-VolumesActionsTest-1913964315 None] Created volume successfully. Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-af038146-c7f8-4631-a82a-7e272933a940" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-af038146-c7f8-4631-a82a-7e272933a940" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[159b552f-31d4-4663-90f8-bae2cd9e7fa2]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:53 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 Sep 30 10:25:53 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:53 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940" returned: 0 in 0.421s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:53 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940 Sep 30 10:25:53 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:53 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af038146-c7f8-4631-a82a-7e272933a940" returned: 0 in 0.269s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-af038146-c7f8-4631-a82a-7e272933a940" released by "delete_volume" :: held 0.748s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['1dc61182-7005-43f4-a5f0-828d234e67c2'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:25:53 devstack cinder-volume[87013]: WARNING cinder.quota [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1049268790 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1049268790, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:25:53 devstack cinder-volume[87013]: WARNING cinder.quota [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1049268790 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1049268790, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['97be2d0f-2380-4c22-b5c5-9f8bd2048b46', '4dab8525-cb9d-4207-ab35-0a969642f7ce', '7a885098-8b34-4d0a-80d6-ce0babab1e55', '4fca64cc-9df5-4f71-8abb-7a5a659efbe5'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Flow 'volume_create_manager' (73dd90ab-b5e9-4d10-a3f5-00313efdefb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19347b09-8bdd-4ad2-bf3f-d79defba4a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19347b09-8bdd-4ad2-bf3f-d79defba4a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-683212758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce3cb75f84942ea8fb4759991ee1edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:54Z,use_quota=True,user_id='086d760b46294fc7a3b0830e0198e5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39d1d1a-fa5c-4e18-bc5b-5aca4635992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39d1d1a-fa5c-4e18-bc5b-5aca4635992a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa63c85-c891-4a57-8d31-95f1fe98b847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa63c85-c891-4a57-8d31-95f1fe98b847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab', 'volume_name': 'volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4848923d-1069-44ac-8d40-bcde1995dd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4848923d-1069-44ac-8d40-bcde1995dd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b188c69-fd94-43d4-9a42-a6cefd03f4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:53 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Volume 6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab', 'volume_size': 1} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-683212758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce3cb75f84942ea8fb4759991ee1edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:54Z,use_quota=True,user_id='086d760b46294fc7a3b0830e0198e5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Creating volume 6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:25:53 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:25:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:53 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab 1073741824 Sep 30 10:25:53 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:54 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:25:54 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Acquiring lock "cinder-3a508e6f-3868-41ec-a8ab-096b69578e96-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Lock "cinder-3a508e6f-3868-41ec-a8ab-096b69578e96-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Acquiring lock "cinder-quobyte-3a508e6f-3868-41ec-a8ab-096b69578e96" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:54 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] group_snapshot fee33b3f-6bf3-4c31-b06a-cde4085a73bc: deleting Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Lock "cinder-quobyte-3a508e6f-3868-41ec-a8ab-096b69578e96" acquired by "delete_volume" :: waited 0.042s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] group_snapshot fee33b3f-6bf3-4c31-b06a-cde4085a73bc: deleting {{(pid=87013) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7279fecb-6a09-4d05-88b6-05cb85a78aa7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-508dce1f-3456-4408-8fb5-a65c87567bc2" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-508dce1f-3456-4408-8fb5-a65c87567bc2" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-904ff73c-0507-48bd-886c-975da75d33e5" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:54 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.454s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:25:54 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-efe26158-f05b-424d-bb22-b68f7a9de1f8 tempest-GroupSnapshotsTest-2146078764 None] Delete group completed successfully. Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-904ff73c-0507-48bd-886c-975da75d33e5" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Deleting offline snapshot 904ff73c-0507-48bd-886c-975da75d33e5 of volume 508dce1f-3456-4408-8fb5-a65c87567bc2 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] snapshot_file for this snap is: volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a13a6f1-33c7-40e8-92fc-e4cdc3f04cac]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:54 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96 Sep 30 10:25:54 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:54 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 Sep 30 10:25:54 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:54 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab 1073741824" returned: 0 in 0.908s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:54 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab Sep 30 10:25:54 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:55 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96" returned: 0 in 0.752s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:55 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5" returned: 0 in 0.572s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-508dce1f-3456-4408-8fb5-a65c87567bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:25:55 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96 Sep 30 10:25:55 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06e24f7-a7f2-4b5e-b15c-3a07902e114e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:55 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab" returned: 0 in 0.330s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b188c69-fd94-43d4-9a42-a6cefd03f4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4468c2-27d2-48a6-ba4d-9ff4e80aef3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:55 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Volume volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab (6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab): created successfully Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4468c2-27d2-48a6-ba4d-9ff4e80aef3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Flow 'volume_create_manager' (73dd90ab-b5e9-4d10-a3f5-00313efdefb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a3895825-1929-40a9-a9e7-5d310a5e95e6 tempest-TaggedAttachmentsTest-270231986 None] Created volume successfully. Sep 30 10:25:55 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 Sep 30 10:25:55 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:55 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3a508e6f-3868-41ec-a8ab-096b69578e96" returned: 0 in 0.298s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Lock "cinder-quobyte-3a508e6f-3868-41ec-a8ab-096b69578e96" released by "delete_volume" :: held 1.146s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Created reservations ['a2a24b4d-4216-4c2b-bab8-15657a43c8f8', '90d753c8-d884-4a71-bd43-99307fe5344c', '2d59dedd-ec44-42c5-bad4-01aa95bd47e7', '0f2b688f-2b03-455c-9624-e7a1d293c44f'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:55 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:25:55 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:55 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2" returned: 0 in 0.603s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:55 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.269s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:25:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Deleted volume successfully. Sep 30 10:25:55 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 Sep 30 10:25:55 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b8c58f6f-470a-421c-b250-8f3f91463201 tempest-VolumesActionsTest-240722379 None] Lock "cinder-3a508e6f-3868-41ec-a8ab-096b69578e96-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:56 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5" returned: 0 in 0.386s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:56 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5 Sep 30 10:25:56 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:56 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2.904ff73c-0507-48bd-886c-975da75d33e5" returned: 0 in 0.291s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-904ff73c-0507-48bd-886c-975da75d33e5" released by "_delete_snapshot" :: held 2.022s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-508dce1f-3456-4408-8fb5-a65c87567bc2" released by "delete_snapshot" :: held 2.081s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:56 devstack cinder-volume[87013]: WARNING cinder.quota [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1049268790 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1049268790, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:25:56 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['50c55321-4a29-40bb-a61f-e45e1d1e0332', 'f7acb785-a428-42cf-a575-fa8264a9735c', 'd4bb645e-2370-445e-8151-e2400ad34e33', '7dde24ed-2007-4f2b-bbca-ff43de680596'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:25:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f9907bba-47a2-410d-b86b-0afb21c2573b tempest-GroupSnapshotsTest-2146078764 None] group_snapshot fee33b3f-6bf3-4c31-b06a-cde4085a73bc: deleted successfully Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (aa97cacc-e6c9-413e-b25e-9c5129788e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a8e13a-801d-49ef-ba60-aeacf83bcc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a8e13a-801d-49ef-ba60-aeacf83bcc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2134002114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7d6f5f-74e1-4ac7-8b32-303857ea67ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:57Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ef5c19-4316-46ec-983f-e03343bf14f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ef5c19-4316-46ec-983f-e03343bf14f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d8b063-31c9-4827-9cb4-8c844dbc241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d8b063-31c9-4827-9cb4-8c844dbc241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7d6f5f-74e1-4ac7-8b32-303857ea67ef', 'volume_name': 'volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f599aaf-b7df-4ace-b239-5ea4facdd76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f599aaf-b7df-4ace-b239-5ea4facdd76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0969dbb1-d5f2-423d-b918-225419abf1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:57 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Volume 5a7d6f5f-74e1-4ac7-8b32-303857ea67ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef', 'volume_size': 1} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2134002114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7d6f5f-74e1-4ac7-8b32-303857ea67ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:25:57Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Creating volume 5a7d6f5f-74e1-4ac7-8b32-303857ea67ef {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:25:57 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:57 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef 1073741824 Sep 30 10:25:57 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:57 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef 1073741824" returned: 0 in 0.646s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:58 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef Sep 30 10:25:58 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-508dce1f-3456-4408-8fb5-a65c87567bc2" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-508dce1f-3456-4408-8fb5-a65c87567bc2" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[471af29f-1800-4cd5-8a88-50b9e47d1c5b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:58 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef" returned: 0 in 0.454s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0969dbb1-d5f2-423d-b918-225419abf1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad189d8-ea8d-45dd-aa7b-0765521edf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:25:58 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Volume volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef (5a7d6f5f-74e1-4ac7-8b32-303857ea67ef): created successfully Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad189d8-ea8d-45dd-aa7b-0765521edf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (aa97cacc-e6c9-413e-b25e-9c5129788e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:25:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-765f2712-90db-44e7-a151-299ff08a6dd8 tempest-VolumesActionsTest-1913964315 None] Created volume successfully. Sep 30 10:25:58 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 Sep 30 10:25:58 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:58 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2" returned: 0 in 0.507s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:58 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2 Sep 30 10:25:58 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:59 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-508dce1f-3456-4408-8fb5-a65c87567bc2" returned: 0 in 0.282s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-508dce1f-3456-4408-8fb5-a65c87567bc2" released by "delete_volume" :: held 0.908s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['547baae4-2982-4ef5-8573-9f87a669acb9'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:25:59 devstack cinder-volume[87013]: WARNING cinder.db.api [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1049268790'] Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['7fe2d403-1383-499b-868c-59eb552f65af', '53ea3385-982b-4b78-9643-22833dec29f8', 'c97a0366-4f59-434e-82a2-19e89184aba3', 'c7a6ce16-0c46-4fc2-ae47-fbb283588e5b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Acquiring lock "cinder-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Lock "cinder-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:59 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:25:59 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Acquiring lock "cinder-quobyte-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Lock "cinder-quobyte-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8ec0c-c788-4968-8d3b-af66f6a76d1c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:25:59 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef Sep 30 10:25:59 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:25:59 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.384s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:25:59 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:25:59 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c2799510-8f9e-4ed5-98d3-1d5bded89d34 tempest-GroupSnapshotsTest-2146078764 None] Delete group completed successfully. Sep 30 10:26:00 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b82a8289-ce13-462c-b945-7cb210ec7d29 tempest-GroupSnapshotsTest-2146078764 None] Group tempest-GroupSnapshotsTest-Group-1269872850: creating Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef" returned: 0 in 0.527s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:00 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef Sep 30 10:26:00 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b82a8289-ce13-462c-b945-7cb210ec7d29 tempest-GroupSnapshotsTest-2146078764 None] Group tempest-GroupSnapshotsTest-Group-1269872850: created successfully Sep 30 10:26:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b82a8289-ce13-462c-b945-7cb210ec7d29 tempest-GroupSnapshotsTest-2146078764 None] Create group completed successfully. Sep 30 10:26:00 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef" returned: 0 in 0.318s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Lock "cinder-quobyte-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef" released by "delete_volume" :: held 0.935s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Created reservations ['67c131fa-a649-485f-9e94-a73ba56be63a', '57a9241f-bb05-41c0-b9ef-8d0a30162b60', '7e4c19df-33cf-40da-989b-29ab30abf3a8', 'ea46bf8a-c065-435a-8ccd-beb32548d47c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:00 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:00 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:01 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.256s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:01 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:01 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Deleted volume successfully. Sep 30 10:26:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cf2d0692-be16-4c05-a4df-07f8eb5bbdbe tempest-VolumesActionsTest-240722379 None] Lock "cinder-5a7d6f5f-74e1-4ac7-8b32-303857ea67ef-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:01 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Flow 'volume_create_manager' (70981ed3-8419-4eb9-a72a-ddf0fcdef0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0e3697-3ca8-4622-9cbf-047ee65ceed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0e3697-3ca8-4622-9cbf-047ee65ceed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1580375035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f23d263-ad97-43d5-ae67-70d992cea879,host='devstack@QuobyteHD#QuobyteHD',id=7cd12275-fe8d-4d60-9877-7f16b77109d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3183af47c9e24d7e966a500f2dc1d7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:02Z,use_quota=True,user_id='c7807657f3e84e3ca8eeef763c850a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5db1229f-2d40-4c49-9f68-7f32175dd7ce),volume_type_id=5db1229f-2d40-4c49-9f68-7f32175dd7ce)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b0345b-b88e-4261-8f71-e5c43b8edc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b0345b-b88e-4261-8f71-e5c43b8edc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edc3f36-d3e4-4585-873a-85dc5e0ceb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edc3f36-d3e4-4585-873a-85dc5e0ceb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd12275-fe8d-4d60-9877-7f16b77109d8', 'volume_name': 'volume-7cd12275-fe8d-4d60-9877-7f16b77109d8', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d76533-6f2b-48c8-99fa-8dddeb1cb7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d76533-6f2b-48c8-99fa-8dddeb1cb7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbdff897-1892-4748-b8f4-b87b3c8d75b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:02 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Volume 7cd12275-fe8d-4d60-9877-7f16b77109d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd12275-fe8d-4d60-9877-7f16b77109d8', 'volume_size': 1} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f23d263-ad97-43d5-ae67-70d992cea879,created_at=2026-09-30T08:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1580375035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f23d263-ad97-43d5-ae67-70d992cea879,host='devstack@QuobyteHD#QuobyteHD',id=7cd12275-fe8d-4d60-9877-7f16b77109d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3183af47c9e24d7e966a500f2dc1d7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:02Z,use_quota=True,user_id='c7807657f3e84e3ca8eeef763c850a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5db1229f-2d40-4c49-9f68-7f32175dd7ce),volume_type_id=5db1229f-2d40-4c49-9f68-7f32175dd7ce)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Creating volume 7cd12275-fe8d-4d60-9877-7f16b77109d8 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:02 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:02 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 1073741824 Sep 30 10:26:02 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:02 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (01ebc25b-b34f-4a57-8d8b-31b6f8b890b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b15c49-91ef-4e99-9d3d-78d024d0b0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 1073741824" returned: 0 in 0.817s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b15c49-91ef-4e99-9d3d-78d024d0b0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1100395596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5824218-21ec-4168-bc31-ad708ff09ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:03Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82f6011-606e-43c9-9e6b-10ca659fa4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82f6011-606e-43c9-9e6b-10ca659fa4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21411d92-0cb8-41ac-b3fc-1f7aa2a6677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21411d92-0cb8-41ac-b3fc-1f7aa2a6677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5824218-21ec-4168-bc31-ad708ff09ede', 'volume_name': 'volume-e5824218-21ec-4168-bc31-ad708ff09ede', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d63ea57-022f-4142-bc75-5e4710c917ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d63ea57-022f-4142-bc75-5e4710c917ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5cc1b1-1675-450c-8908-71cbe377a2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:02 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Volume e5824218-21ec-4168-bc31-ad708ff09ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5824218-21ec-4168-bc31-ad708ff09ede', 'volume_size': 1} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:03 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 Sep 30 10:26:03 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:03 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8" returned: 0 in 0.415s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1100395596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5824218-21ec-4168-bc31-ad708ff09ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:03Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Creating volume e5824218-21ec-4168-bc31-ad708ff09ede {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:03 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbdff897-1892-4748-b8f4-b87b3c8d75b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd12275-fe8d-4d60-9877-7f16b77109d8', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3337da34-e4a5-4e63-a94a-897b06bd9016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:03 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede 1073741824 Sep 30 10:26:03 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:03 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Volume volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 (7cd12275-fe8d-4d60-9877-7f16b77109d8): created successfully Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3337da34-e4a5-4e63-a94a-897b06bd9016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Flow 'volume_create_manager' (70981ed3-8419-4eb9-a72a-ddf0fcdef0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:03 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-40f8a820-2ee0-44b1-bf61-0b68e53d6b42 tempest-GroupSnapshotsTest-2146078764 None] Created volume successfully. Sep 30 10:26:04 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede 1073741824" returned: 0 in 0.724s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:04 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede Sep 30 10:26:04 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:04 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede" returned: 0 in 0.293s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5cc1b1-1675-450c-8908-71cbe377a2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5824218-21ec-4168-bc31-ad708ff09ede', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f4a0782-faf8-413b-9b76-e4bb5532bd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:04 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Volume volume-e5824218-21ec-4168-bc31-ad708ff09ede (e5824218-21ec-4168-bc31-ad708ff09ede): created successfully Sep 30 10:26:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f4a0782-faf8-413b-9b76-e4bb5532bd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (01ebc25b-b34f-4a57-8d8b-31b6f8b890b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:04 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a9a9e208-6634-4bec-9592-afcdd050185e tempest-VolumesActionsTest-1913964315 None] Created volume successfully. Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Flow 'volume_create_manager' (28f99c81-2a34-4097-a061-7adcf68b4854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847f30b3-a30d-4884-a4a2-cfb5071e745a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Acquiring lock "cinder-e5824218-21ec-4168-bc31-ad708ff09ede-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847f30b3-a30d-4884-a4a2-cfb5071e745a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-974984575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f23d263-ad97-43d5-ae67-70d992cea879,host='devstack@QuobyteHD#QuobyteHD',id=7a7731dc-80f5-41c6-bdf2-4135331ac522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3183af47c9e24d7e966a500f2dc1d7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:05Z,use_quota=True,user_id='c7807657f3e84e3ca8eeef763c850a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5db1229f-2d40-4c49-9f68-7f32175dd7ce),volume_type_id=5db1229f-2d40-4c49-9f68-7f32175dd7ce)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d35967-ae36-4127-b90e-5ae0013c0766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d35967-ae36-4127-b90e-5ae0013c0766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e0ac1b-a8f4-4001-aee7-fd3aa9bca5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e0ac1b-a8f4-4001-aee7-fd3aa9bca5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7731dc-80f5-41c6-bdf2-4135331ac522', 'volume_name': 'volume-7a7731dc-80f5-41c6-bdf2-4135331ac522', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4608a2b4-7180-4904-9e84-83f7e8d8c532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4608a2b4-7180-4904-9e84-83f7e8d8c532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dce2127-1839-416b-9607-d9fb63a8dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:05 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Volume 7a7731dc-80f5-41c6-bdf2-4135331ac522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7731dc-80f5-41c6-bdf2-4135331ac522', 'volume_size': 1} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f23d263-ad97-43d5-ae67-70d992cea879,created_at=2026-09-30T08:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-974984575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f23d263-ad97-43d5-ae67-70d992cea879,host='devstack@QuobyteHD#QuobyteHD',id=7a7731dc-80f5-41c6-bdf2-4135331ac522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3183af47c9e24d7e966a500f2dc1d7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:05Z,use_quota=True,user_id='c7807657f3e84e3ca8eeef763c850a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5db1229f-2d40-4c49-9f68-7f32175dd7ce),volume_type_id=5db1229f-2d40-4c49-9f68-7f32175dd7ce)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Creating volume 7a7731dc-80f5-41c6-bdf2-4135331ac522 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:05 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:05 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 1073741824 Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Lock "cinder-e5824218-21ec-4168-bc31-ad708ff09ede-delete_volume" acquired by "delete_volume" :: waited 0.177s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:05 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Acquiring lock "cinder-quobyte-e5824218-21ec-4168-bc31-ad708ff09ede" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Lock "cinder-quobyte-e5824218-21ec-4168-bc31-ad708ff09ede" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f63938d-2375-470c-b8ff-6f44aec986ef]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:05 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede Sep 30 10:26:05 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:06 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede" returned: 0 in 0.506s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:06 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 1073741824" returned: 0 in 0.678s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:06 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede Sep 30 10:26:06 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:06 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:06 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:06 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e5824218-21ec-4168-bc31-ad708ff09ede" returned: 0 in 0.464s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Lock "cinder-quobyte-e5824218-21ec-4168-bc31-ad708ff09ede" released by "delete_volume" :: held 1.073s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Created reservations ['d313750b-b5c5-4cad-9b04-fff0482477b2', 'c7edaa4d-0081-4617-b8f2-d02fab6f676b', 'a4366361-9efc-4669-92c9-933eb00e6c19', '90a3f648-4c0c-44a8-98f0-9d35cb88cf56'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:06 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522" returned: 0 in 0.577s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dce2127-1839-416b-9607-d9fb63a8dc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7731dc-80f5-41c6-bdf2-4135331ac522', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5cbdfc-d36b-41ba-9432-3739cfd21e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:06 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Volume volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 (7a7731dc-80f5-41c6-bdf2-4135331ac522): created successfully Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5cbdfc-d36b-41ba-9432-3739cfd21e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Flow 'volume_create_manager' (28f99c81-2a34-4097-a061-7adcf68b4854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a067a407-fb25-4829-8e16-bc3670cf411f tempest-GroupSnapshotsTest-2146078764 None] Created volume successfully. Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:06 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:06 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:07 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.450s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:07 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:07 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Deleted volume successfully. Sep 30 10:26:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-261477bf-8e35-4267-b1ed-4b1f21c031e0 tempest-VolumesActionsTest-240722379 None] Lock "cinder-e5824218-21ec-4168-bc31-ad708ff09ede-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:08 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-1e8a52e4-2df9-495b-89e3-cadd25d70d4e tempest-GroupSnapshotsTest-2146078764 None] Update group completed successfully. Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (6ad2aa7f-2022-4084-8c1b-a823c57a0d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b16bff2-b898-4083-bf09-063e13e106a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b16bff2-b898-4083-bf09-063e13e106a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538396110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8c87ca-8e22-4aef-affe-a5a2f9a37470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:08Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a336768-094c-4e25-a545-230b489e0718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a336768-094c-4e25-a545-230b489e0718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bccbdd-e7a8-47c4-95fe-fa30a4fa31b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bccbdd-e7a8-47c4-95fe-fa30a4fa31b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8c87ca-8e22-4aef-affe-a5a2f9a37470', 'volume_name': 'volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15eef82-2914-4ea5-b094-3160d68bf404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15eef82-2914-4ea5-b094-3160d68bf404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1578b7dc-4328-472c-87e4-e375819841a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:08 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Volume 0c8c87ca-8e22-4aef-affe-a5a2f9a37470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470', 'volume_size': 1} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538396110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8c87ca-8e22-4aef-affe-a5a2f9a37470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:08Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Creating volume 0c8c87ca-8e22-4aef-affe-a5a2f9a37470 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:08 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:08 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470 1073741824 Sep 30 10:26:08 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:09 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470 1073741824" returned: 0 in 0.613s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:09 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470 Sep 30 10:26:09 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:09 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ddc7f53d-f731-40d1-94ee-c62bb5d0c562 tempest-GroupSnapshotsTest-2146078764 None] Update group completed successfully. Sep 30 10:26:09 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470" returned: 0 in 0.575s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1578b7dc-4328-472c-87e4-e375819841a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb99f88-88e4-4970-b314-c80e8c8c2ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:09 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Volume volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470 (0c8c87ca-8e22-4aef-affe-a5a2f9a37470): created successfully Sep 30 10:26:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb99f88-88e4-4970-b314-c80e8c8c2ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (6ad2aa7f-2022-4084-8c1b-a823c57a0d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:09 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-1b7f6509-c217-4558-b62b-b6046d6989ca tempest-VolumesActionsTest-1913964315 None] Created volume successfully. Sep 30 10:26:10 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-dd09ca3b-7777-457e-9b11-5beee1db7415 tempest-GroupSnapshotsTest-2146078764 None] Update group completed successfully. Sep 30 10:26:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Acquiring lock "cinder-0c8c87ca-8e22-4aef-affe-a5a2f9a37470-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Lock "cinder-0c8c87ca-8e22-4aef-affe-a5a2f9a37470-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Acquiring lock "cinder-quobyte-0c8c87ca-8e22-4aef-affe-a5a2f9a37470" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Lock "cinder-quobyte-0c8c87ca-8e22-4aef-affe-a5a2f9a37470" acquired by "delete_volume" :: waited 0.037s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:11 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[87751a8d-3ceb-4200-afc7-83d017a8dab7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:11 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470 Sep 30 10:26:11 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:11 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470" returned: 0 in 0.630s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:12 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470 Sep 30 10:26:12 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-702ac369-a1a6-4def-a9bf-6b30996085ad tempest-GroupSnapshotsTest-2146078764 None] Update group completed successfully. Sep 30 10:26:12 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c8c87ca-8e22-4aef-affe-a5a2f9a37470" returned: 0 in 0.350s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Lock "cinder-quobyte-0c8c87ca-8e22-4aef-affe-a5a2f9a37470" released by "delete_volume" :: held 1.081s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Created reservations ['36d9013d-e62c-437d-9722-39e88dfb95b9', '5b410b2e-eeaf-423b-b6d3-f8b9c3b905dd', '21c2e62f-5e0f-4bc5-9dfe-5e6ccbfc8472', 'c2386603-ec62-4507-9306-ca0bdf36c989'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:12 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:12 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:12 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.328s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Deleted volume successfully. Sep 30 10:26:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-413c785e-5a59-4d90-8150-5266996f21c9 tempest-VolumesActionsTest-240722379 None] Lock "cinder-0c8c87ca-8e22-4aef-affe-a5a2f9a37470-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:13 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] GroupSnapshot 84fd5c67-38b5-49a9-9dfa-ca7754d1bb46: creating. Sep 30 10:26:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Group snapshot 84fd5c67-38b5-49a9-9dfa-ca7754d1bb46: creating. {{(pid=87013) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 10:26:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Creating offline snapshot c19fa4e7-052a-401a-812f-36b80f0a65eb of volume 7a7731dc-80f5-41c6-bdf2-4135331ac522 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:26:14 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1421f57-d8ef-42f7-82a2-604ada9d3e5e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:14 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 Sep 30 10:26:14 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:15 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522" returned: 0 in 0.937s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:15 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb 1G Sep 30 10:26:15 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (2bfc70bf-b446-42a0-a079-0bedd8ca7fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f26865-c2c9-49de-b840-a38ae4577ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f26865-c2c9-49de-b840-a38ae4577ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1869838003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b166b36d-2932-4c6a-bad8-6c4bea914349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:15Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b772bf-28ff-4220-9d70-5e63a3f9b24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b772bf-28ff-4220-9d70-5e63a3f9b24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de78e642-45ea-4b84-9900-ef52619cff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de78e642-45ea-4b84-9900-ef52619cff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b166b36d-2932-4c6a-bad8-6c4bea914349', 'volume_name': 'volume-b166b36d-2932-4c6a-bad8-6c4bea914349', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61d3b0d-e571-40b4-ba0d-3c33d45e8d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61d3b0d-e571-40b4-ba0d-3c33d45e8d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b235cf5-e14f-4a58-9a0b-18a1ca03afff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:15 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Volume b166b36d-2932-4c6a-bad8-6c4bea914349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b166b36d-2932-4c6a-bad8-6c4bea914349', 'volume_size': 1} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:15 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb 1G" returned: 0 in 0.731s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:15 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb Sep 30 10:26:15 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:16 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb" returned: 0 in 0.390s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:16 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:26:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:16 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb Sep 30 10:26:16 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:16 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb" returned: 0 in 0.241s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:16 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.info Sep 30 10:26:16 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:16 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.info" returned: 0 in 0.265s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:16 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:26:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:16 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.info Sep 30 10:26:16 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:17 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.info" returned: 0 in 0.373s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Creating offline snapshot f74429e4-1eb5-4136-9205-51de79cca568 of volume 7cd12275-fe8d-4d60-9877-7f16b77109d8 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:26:17 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50917fb-c0ce-4d08-8bbf-0ffaadb1c5b5]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:17 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 Sep 30 10:26:17 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:17 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8" returned: 0 in 0.492s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:17 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 1G Sep 30 10:26:17 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:18 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 1G" returned: 0 in 0.479s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:18 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 Sep 30 10:26:18 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:18 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568" returned: 0 in 0.312s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:18 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:26:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:18 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 Sep 30 10:26:18 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:18 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568" returned: 0 in 0.305s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:19 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.info Sep 30 10:26:19 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:19 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.info" returned: 0 in 0.330s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:19 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:19 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.info Sep 30 10:26:19 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:19 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.info" returned: 0 in 0.380s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.311s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1869838003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b166b36d-2932-4c6a-bad8-6c4bea914349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfac6b6fa77a48958c2fb076cbbc1617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:15Z,use_quota=True,user_id='73c13893873841abaca2861097d464db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Creating volume b166b36d-2932-4c6a-bad8-6c4bea914349 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:19 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:19 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349 1073741824 Sep 30 10:26:19 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:19 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c90f8c74-9408-42e8-ae1b-c802d07eabc7 tempest-GroupSnapshotsTest-2146078764 None] group_snapshot 84fd5c67-38b5-49a9-9dfa-ca7754d1bb46: created successfully Sep 30 10:26:20 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349 1073741824" returned: 0 in 0.810s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:20 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349 Sep 30 10:26:20 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] group_snapshot 84fd5c67-38b5-49a9-9dfa-ca7754d1bb46: deleting Sep 30 10:26:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] group_snapshot 84fd5c67-38b5-49a9-9dfa-ca7754d1bb46: deleting {{(pid=87013) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 10:26:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-7a7731dc-80f5-41c6-bdf2-4135331ac522" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-7a7731dc-80f5-41c6-bdf2-4135331ac522" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-c19fa4e7-052a-401a-812f-36b80f0a65eb" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-c19fa4e7-052a-401a-812f-36b80f0a65eb" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Deleting offline snapshot c19fa4e7-052a-401a-812f-36b80f0a65eb of volume 7a7731dc-80f5-41c6-bdf2-4135331ac522 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:26:21 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] snapshot_file for this snap is: volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349" returned: 0 in 0.488s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b235cf5-e14f-4a58-9a0b-18a1ca03afff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b166b36d-2932-4c6a-bad8-6c4bea914349', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afc4bd9-082a-48db-85e6-7531be4ad5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a505253-a7ae-4a3e-bd19-1f7738759cd2]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:21 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Volume volume-b166b36d-2932-4c6a-bad8-6c4bea914349 (b166b36d-2932-4c6a-bad8-6c4bea914349): created successfully Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afc4bd9-082a-48db-85e6-7531be4ad5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Flow 'volume_create_manager' (2bfc70bf-b446-42a0-a079-0bedd8ca7fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:21 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-838698d4-0bcc-40fb-ac08-db674c17ff15 tempest-VolumesActionsTest-1913964315 None] Created volume successfully. Sep 30 10:26:21 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb Sep 30 10:26:21 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:21 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb" returned: 0 in 0.559s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a7731dc-80f5-41c6-bdf2-4135331ac522(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6890a5-ff8d-41bc-a414-72fe83a6e9a4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:21 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 Sep 30 10:26:21 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:22 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522" returned: 0 in 0.571s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:22 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb Sep 30 10:26:22 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Acquiring lock "cinder-b166b36d-2932-4c6a-bad8-6c4bea914349-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Lock "cinder-b166b36d-2932-4c6a-bad8-6c4bea914349-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Acquiring lock "cinder-quobyte-b166b36d-2932-4c6a-bad8-6c4bea914349" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Lock "cinder-quobyte-b166b36d-2932-4c6a-bad8-6c4bea914349" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:22 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e911d8a9-f6ad-4bcc-8ac9-a0364d46e490]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:22 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb" returned: 0 in 0.559s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:22 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349 Sep 30 10:26:22 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:22 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb Sep 30 10:26:22 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:23 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522.c19fa4e7-052a-401a-812f-36b80f0a65eb" returned: 0 in 0.299s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-c19fa4e7-052a-401a-812f-36b80f0a65eb" released by "_delete_snapshot" :: held 2.195s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-7a7731dc-80f5-41c6-bdf2-4135331ac522" released by "delete_snapshot" :: held 2.237s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-7cd12275-fe8d-4d60-9877-7f16b77109d8" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-7cd12275-fe8d-4d60-9877-7f16b77109d8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-f74429e4-1eb5-4136-9205-51de79cca568" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:23 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349" returned: 0 in 0.502s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-f74429e4-1eb5-4136-9205-51de79cca568" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Deleting offline snapshot f74429e4-1eb5-4136-9205-51de79cca568 of volume 7cd12275-fe8d-4d60-9877-7f16b77109d8 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:26:23 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349 Sep 30 10:26:23 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] snapshot_file for this snap is: volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[67349a38-69ab-45d9-8853-a674631d0b14]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:23 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 Sep 30 10:26:23 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:23 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b166b36d-2932-4c6a-bad8-6c4bea914349" returned: 0 in 0.323s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Lock "cinder-quobyte-b166b36d-2932-4c6a-bad8-6c4bea914349" released by "delete_volume" :: held 0.893s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Created reservations ['427fab6c-a646-4c3e-bfe3-ce792a649dee', '1e063e18-fe8a-4770-a8a1-afa53f036261', 'c05bdd27-751d-434f-a38f-c66125a1cec5', '34a7356d-9ac3-47ad-ba52-38e93b96d034'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:23 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568" returned: 0 in 0.453s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cd12275-fe8d-4d60-9877-7f16b77109d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:26:23 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:23 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76a70b8-1c5e-4b1d-a54e-2556a4ebf443]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:23 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 Sep 30 10:26:23 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:24 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.323s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:24 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:24 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Deleted volume successfully. Sep 30 10:26:24 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-899015f1-c238-417a-8ff0-b9c2a9c6fdc4 tempest-VolumesActionsTest-1913964315 None] Lock "cinder-b166b36d-2932-4c6a-bad8-6c4bea914349-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:24 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8" returned: 0 in 0.429s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:24 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 Sep 30 10:26:24 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:24 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568" returned: 0 in 0.459s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:24 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568 Sep 30 10:26:24 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:25 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8.f74429e4-1eb5-4136-9205-51de79cca568" returned: 0 in 0.265s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:25 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-f74429e4-1eb5-4136-9205-51de79cca568" released by "_delete_snapshot" :: held 1.750s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:25 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-7cd12275-fe8d-4d60-9877-7f16b77109d8" released by "delete_snapshot" :: held 1.793s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:25 devstack cinder-volume[87013]: WARNING cinder.quota [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1706917608 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1706917608, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:26:25 devstack cinder-volume[87013]: WARNING cinder.quota [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1706917608 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1706917608, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:26:25 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['c7170e38-6878-48e8-95d8-c618985d8799', '9d557334-5b0a-4d65-999d-0b499ee962f3', '05be6658-06de-437b-a11c-cd7aa03fb89d', '9d3bf555-3e58-46f6-aab2-7b892eb1315f'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:25 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['500bbe66-0e75-4a80-81d0-84b5c719a5d5', 'ccab1565-d43c-4fd0-956f-c49be53423f6', '662dd44b-ec2b-4cc1-8015-763b2059e18c', '755a81be-334b-4395-896f-c23ecc75173b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:25 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9f66dcc7-3c01-4c7d-99b1-15350e0a5c40 tempest-GroupSnapshotsTest-2146078764 None] group_snapshot 84fd5c67-38b5-49a9-9dfa-ca7754d1bb46: deleted successfully Sep 30 10:26:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-7a7731dc-80f5-41c6-bdf2-4135331ac522" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-7a7731dc-80f5-41c6-bdf2-4135331ac522" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:26 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dbef14-8c0a-4f10-9ad1-38d23c0ebe25]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:26 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 Sep 30 10:26:26 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:27 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522" returned: 0 in 0.626s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:27 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522 Sep 30 10:26:27 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:27 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a7731dc-80f5-41c6-bdf2-4135331ac522" returned: 0 in 0.340s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-7a7731dc-80f5-41c6-bdf2-4135331ac522" released by "delete_volume" :: held 1.077s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-7cd12275-fe8d-4d60-9877-7f16b77109d8" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-7cd12275-fe8d-4d60-9877-7f16b77109d8" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:27 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6e7d87-cc5c-410b-b039-9a22cad4b15a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:27 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 Sep 30 10:26:27 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:28 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8" returned: 0 in 0.473s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:28 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8 Sep 30 10:26:28 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:28 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7cd12275-fe8d-4d60-9877-7f16b77109d8" returned: 0 in 0.486s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-7cd12275-fe8d-4d60-9877-7f16b77109d8" released by "delete_volume" :: held 1.059s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:28 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['8d074a97-361c-4a5b-b77e-806286dc9cdd'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:28 devstack cinder-volume[87013]: WARNING cinder.quota [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1706917608 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1706917608, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:26:28 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['12973d7b-0135-46a1-85cd-362edd7e2df2', 'd5356eef-335e-4781-b048-1079d3e33922', '2df5073d-2538-497b-9c2f-1628fe51ccc4', '340237d0-b44d-4bfc-8e7d-5d0c2a8f79de'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['e1d057e3-1e65-45d4-8c0f-c86b29306746', '8cd11b60-998a-47dc-8c21-30ee8d1483b2', 'd80cac04-db13-4e2b-852b-779e54a1e77b', '35aa975d-9a87-4ea5-aa38-c781f95e8e72'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:DELETE=12,cinder:SELECT=136,cinder:UPDATE=155,cinder:INSERT=31 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=141,cinder:SELECT=129,cinder:INSERT=39,cinder:DELETE=4 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:29 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:29 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:29 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.400s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:29 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:29 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-6529f22a-8d62-4b4e-80ec-5b918129b8bb tempest-GroupSnapshotsTest-2146078764 None] Delete group completed successfully. Sep 30 10:26:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-95c4264f-8350-4066-96cb-9666707058a6 tempest-GroupSnapshotsTest-2146078764 None] Group tempest-GroupSnapshotsTest-Group-989162351: creating Sep 30 10:26:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-95c4264f-8350-4066-96cb-9666707058a6 tempest-GroupSnapshotsTest-2146078764 None] Group tempest-GroupSnapshotsTest-Group-989162351: created successfully Sep 30 10:26:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-95c4264f-8350-4066-96cb-9666707058a6 tempest-GroupSnapshotsTest-2146078764 None] Create group completed successfully. Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Flow 'volume_create_manager' (6d5bd02f-747c-4d3e-bba0-0f20a4651579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ca3565-8eb2-43c8-9d53-4fbce4e4129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ca3565-8eb2-43c8-9d53-4fbce4e4129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1335780502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2bcce688-42c6-4980-9698-4217d0de433a,host='devstack@QuobyteHD#QuobyteHD',id=0fee3689-a55d-4a12-99f5-f878a6990b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3183af47c9e24d7e966a500f2dc1d7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:32Z,use_quota=True,user_id='c7807657f3e84e3ca8eeef763c850a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77387502-f7a1-4748-8041-3ebba66a2962),volume_type_id=77387502-f7a1-4748-8041-3ebba66a2962)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944721bd-13c0-4e0a-bbc8-d64c2050f999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944721bd-13c0-4e0a-bbc8-d64c2050f999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc834509-a91d-49ac-b6d6-d3feacbb23bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc834509-a91d-49ac-b6d6-d3feacbb23bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fee3689-a55d-4a12-99f5-f878a6990b73', 'volume_name': 'volume-0fee3689-a55d-4a12-99f5-f878a6990b73', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69546ddd-7542-410b-b3b5-339c4c57fd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69546ddd-7542-410b-b3b5-339c4c57fd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0995a4dc-6610-4c64-bbba-4f4399b44bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Volume 0fee3689-a55d-4a12-99f5-f878a6990b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fee3689-a55d-4a12-99f5-f878a6990b73', 'volume_size': 1} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2bcce688-42c6-4980-9698-4217d0de433a,created_at=2026-09-30T08:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1335780502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2bcce688-42c6-4980-9698-4217d0de433a,host='devstack@QuobyteHD#QuobyteHD',id=0fee3689-a55d-4a12-99f5-f878a6990b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3183af47c9e24d7e966a500f2dc1d7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:32Z,use_quota=True,user_id='c7807657f3e84e3ca8eeef763c850a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77387502-f7a1-4748-8041-3ebba66a2962),volume_type_id=77387502-f7a1-4748-8041-3ebba66a2962)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Creating volume 0fee3689-a55d-4a12-99f5-f878a6990b73 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:32 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:32 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 1073741824 Sep 30 10:26:32 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:32 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 1073741824" returned: 0 in 0.432s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:33 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 Sep 30 10:26:33 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:33 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73" returned: 0 in 0.237s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0995a4dc-6610-4c64-bbba-4f4399b44bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fee3689-a55d-4a12-99f5-f878a6990b73', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209651ac-635d-4113-a289-aa436b9fb3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:33 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Volume volume-0fee3689-a55d-4a12-99f5-f878a6990b73 (0fee3689-a55d-4a12-99f5-f878a6990b73): created successfully Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209651ac-635d-4113-a289-aa436b9fb3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Flow 'volume_create_manager' (6d5bd02f-747c-4d3e-bba0-0f20a4651579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:33 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7b5973df-2408-4ed9-b19e-f9bf63b4aae5 tempest-GroupSnapshotsTest-2146078764 None] Created volume successfully. Sep 30 10:26:33 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] GroupSnapshot 279c906b-e845-46de-b771-ba28274fea57: creating. Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Group snapshot 279c906b-e845-46de-b771-ba28274fea57: creating. {{(pid=87013) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Creating offline snapshot 1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d of volume 0fee3689-a55d-4a12-99f5-f878a6990b73 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:26:34 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6530151e-385c-4c7e-9420-517933147ef4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:34 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 Sep 30 10:26:34 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:34 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73" returned: 0 in 0.413s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:34 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d 1G Sep 30 10:26:34 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:34 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d 1G" returned: 0 in 0.515s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fee3689-a55d-4a12-99f5-f878a6990b73 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:34 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fee3689-a55d-4a12-99f5-f878a6990b73 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d Sep 30 10:26:34 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:35 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fee3689-a55d-4a12-99f5-f878a6990b73 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d" returned: 0 in 0.375s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:35 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:26:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:35 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d Sep 30 10:26:35 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:35 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d" returned: 0 in 0.265s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:35 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.info Sep 30 10:26:35 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:35 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.info" returned: 0 in 0.314s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:35 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:26:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:35 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.info Sep 30 10:26:35 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:36 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.info" returned: 0 in 0.303s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:36 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-bbb8c7ac-ebc0-4405-a913-81e14a20a1ed tempest-GroupSnapshotsTest-2146078764 None] group_snapshot 279c906b-e845-46de-b771-ba28274fea57: created successfully Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:37 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:37 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:37 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] group_snapshot 279c906b-e845-46de-b771-ba28274fea57: deleting Sep 30 10:26:37 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.436s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 8 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] group_snapshot 279c906b-e845-46de-b771-ba28274fea57: deleting {{(pid=87013) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-0fee3689-a55d-4a12-99f5-f878a6990b73" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-0fee3689-a55d-4a12-99f5-f878a6990b73" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Deleting offline snapshot 1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d of volume 0fee3689-a55d-4a12-99f5-f878a6990b73 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] snapshot_file for this snap is: volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f766276-47db-4855-9d25-f8a037f10cda]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:37 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d Sep 30 10:26:37 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:38 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d" returned: 0 in 0.789s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fee3689-a55d-4a12-99f5-f878a6990b73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:26:38 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f389f090-923c-4713-8b7b-ad4264f58a31]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:38 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 Sep 30 10:26:38 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:39 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73" returned: 0 in 0.855s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:39 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d Sep 30 10:26:39 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:39 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d" returned: 0 in 0.415s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:39 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d Sep 30 10:26:39 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:40 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73.1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d" returned: 0 in 0.306s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-1c16ffea-6afe-4fb2-84cf-0a1a85e90f9d" released by "_delete_snapshot" :: held 2.605s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-0fee3689-a55d-4a12-99f5-f878a6990b73" released by "delete_snapshot" :: held 2.639s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-fef2f0b9-033a-4834-8fe7-a8c3da00999d req-220be48d-402e-4730-b1fa-08e30c398c10 tempest-TaggedAttachmentsTest-270231986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-fef2f0b9-033a-4834-8fe7-a8c3da00999d req-220be48d-402e-4730-b1fa-08e30c398c10 tempest-TaggedAttachmentsTest-270231986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-fef2f0b9-033a-4834-8fe7-a8c3da00999d req-220be48d-402e-4730-b1fa-08e30c398c10 tempest-TaggedAttachmentsTest-270231986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:40 devstack cinder-volume[87013]: WARNING cinder.quota [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1388088723 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1388088723, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:26:40 devstack cinder-volume[87013]: WARNING cinder.quota [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1388088723 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1388088723, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:26:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-fef2f0b9-033a-4834-8fe7-a8c3da00999d req-220be48d-402e-4730-b1fa-08e30c398c10 tempest-TaggedAttachmentsTest-270231986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '795aee37-0318-401b-a740-06f905140ca6', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:26:40 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['41ea146d-abbe-4503-962b-d073c8c79d76', '092c489d-a41d-4309-9919-29233b81978d', '67b48771-4426-49fc-b05d-b49d1a02f623', '157bc0eb-793e-4ec1-bbda-23b0f81fb28c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-fef2f0b9-033a-4834-8fe7-a8c3da00999d req-220be48d-402e-4730-b1fa-08e30c398c10 tempest-TaggedAttachmentsTest-270231986 None] attachment_update completed successfully. Sep 30 10:26:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a0b2eaad-5bc0-4add-a35a-c98ab701c301 tempest-GroupSnapshotsTest-2146078764 None] group_snapshot 279c906b-e845-46de-b771-ba28274fea57: deleted successfully Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Flow 'volume_create_manager' (79167eee-f3b1-401c-b541-c016a54ff7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7faf48d8-89d5-4068-8958-8263a926ce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7faf48d8-89d5-4068-8958-8263a926ce8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1341930945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37d289c-e131-4034-b668-a5e6b3288e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d94e389e4334c648d189d3afcfb22a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:41Z,use_quota=True,user_id='411037e8da24488e98d293b2262e049a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a49f2c5-21f0-4576-b96b-a62053710bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a49f2c5-21f0-4576-b96b-a62053710bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffba271-ca63-4b58-ae27-52b45af91d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffba271-ca63-4b58-ae27-52b45af91d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37d289c-e131-4034-b668-a5e6b3288e59', 'volume_name': 'volume-b37d289c-e131-4034-b668-a5e6b3288e59', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224d4886-cd36-4d6a-82eb-06f324d9fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224d4886-cd36-4d6a-82eb-06f324d9fbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979025c8-7594-4e89-b350-29c494adb3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:41 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Volume b37d289c-e131-4034-b668-a5e6b3288e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37d289c-e131-4034-b668-a5e6b3288e59', 'volume_size': 1} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1341930945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37d289c-e131-4034-b668-a5e6b3288e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d94e389e4334c648d189d3afcfb22a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:41Z,use_quota=True,user_id='411037e8da24488e98d293b2262e049a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Creating volume b37d289c-e131-4034-b668-a5e6b3288e59 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:41 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:41 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59 1073741824 Sep 30 10:26:41 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "cinder-quobyte-0fee3689-a55d-4a12-99f5-f878a6990b73" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-0fee3689-a55d-4a12-99f5-f878a6990b73" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[353eaf2c-4fad-41fb-ad1b-593f70a474b9]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Flow 'volume_create_manager' (00377d7d-9f0b-485f-bbb4-d8f7d19ddc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b21b488-05ed-4b7f-8d8c-2471986a7ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:42 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59 1073741824" returned: 0 in 0.604s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b21b488-05ed-4b7f-8d8c-2471986a7ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-372099293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2923b103-6c7a-406f-9ddf-c1137a61d0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87021675d32d46a6a59f6a04e5dc1637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:42Z,use_quota=True,user_id='ababaee480244e71bf87e988f460b7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e80d57e-c66d-44dd-9ff7-0aa3e7312a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e80d57e-c66d-44dd-9ff7-0aa3e7312a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:42 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 Sep 30 10:26:42 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6816ed7-f47c-4607-84d7-f904eff986bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6816ed7-f47c-4607-84d7-f904eff986bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2923b103-6c7a-406f-9ddf-c1137a61d0b5', 'volume_name': 'volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5dac65-1d8c-4e32-a51a-544e2e3b0bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5dac65-1d8c-4e32-a51a-544e2e3b0bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f645f8-96c5-4d6e-a05a-fbb28354c1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:42 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Volume 2923b103-6c7a-406f-9ddf-c1137a61d0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5', 'volume_size': 1} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:42 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59 Sep 30 10:26:42 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:42 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73" returned: 0 in 0.408s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:42 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73 Sep 30 10:26:42 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:42 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59" returned: 0 in 0.281s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-372099293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2923b103-6c7a-406f-9ddf-c1137a61d0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87021675d32d46a6a59f6a04e5dc1637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:42Z,use_quota=True,user_id='ababaee480244e71bf87e988f460b7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Creating volume 2923b103-6c7a-406f-9ddf-c1137a61d0b5 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:42 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979025c8-7594-4e89-b350-29c494adb3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37d289c-e131-4034-b668-a5e6b3288e59', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:42 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5 1073741824 Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc24033-15c8-404f-b8ea-0b65dcc82921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:42 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:42 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Volume volume-b37d289c-e131-4034-b668-a5e6b3288e59 (b37d289c-e131-4034-b668-a5e6b3288e59): created successfully Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc24033-15c8-404f-b8ea-0b65dcc82921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Flow 'volume_create_manager' (79167eee-f3b1-401c-b541-c016a54ff7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:42 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-58c1f82e-9df7-4c3f-a9ed-02c51f4dd07a tempest-AttachVolumeTestJSON-1730628854 None] Created volume successfully. Sep 30 10:26:42 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0fee3689-a55d-4a12-99f5-f878a6990b73" returned: 0 in 0.304s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Lock "cinder-quobyte-0fee3689-a55d-4a12-99f5-f878a6990b73" released by "delete_volume" :: held 0.806s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['a935c120-f29d-404f-abe0-4d8f5107c3ca'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:42 devstack cinder-volume[87013]: WARNING cinder.quota [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1388088723 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1388088723, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Created reservations ['b44c108e-3093-4e87-99ae-531f16e8c53d', 'd043522a-7b7c-4aab-a128-95f7c8236d23', '1c25f138-b289-4e3b-b54b-a9209c2bdfcb', '032ba61d-d36d-4f38-9835-899ff67826c2'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:42 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:42 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:42 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5 1073741824" returned: 0 in 0.563s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:43 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5 Sep 30 10:26:43 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:43 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.319s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-74565443-6864-4c50-83f0-57b4a607daa4 tempest-GroupSnapshotsTest-2146078764 None] Delete group completed successfully. Sep 30 10:26:43 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5" returned: 0 in 0.330s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f645f8-96c5-4d6e-a05a-fbb28354c1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c5077f-1812-4df7-8674-795ad1be178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:43 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Volume volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5 (2923b103-6c7a-406f-9ddf-c1137a61d0b5): created successfully Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c5077f-1812-4df7-8674-795ad1be178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Flow 'volume_create_manager' (00377d7d-9f0b-485f-bbb4-d8f7d19ddc02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-38a8acdf-4171-4bb9-82f3-81ff12848230 tempest-VolumesListAdminTestJSON-1615660679 None] Created volume successfully. Sep 30 10:26:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-1873226e-48f9-4c58-9b01-9ebb46edb824 req-6b313f82-88ea-4d8b-a706-f960e2b05bd6 tempest-TaggedAttachmentsTest-270231986 None] Terminate volume connection completed successfully. Sep 30 10:26:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-1873226e-48f9-4c58-9b01-9ebb46edb824 req-6b313f82-88ea-4d8b-a706-f960e2b05bd6 tempest-TaggedAttachmentsTest-270231986 None] Deleting attachment 795aee37-0318-401b-a740-06f905140ca6. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:26:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-f78a1629-d186-4902-8781-c569b6306852 req-634b3681-aa9c-4c9d-b8ad-b51ba55b35a1 tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-f78a1629-d186-4902-8781-c569b6306852 req-634b3681-aa9c-4c9d-b8ad-b51ba55b35a1 tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-f78a1629-d186-4902-8781-c569b6306852 req-634b3681-aa9c-4c9d-b8ad-b51ba55b35a1 tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-f78a1629-d186-4902-8781-c569b6306852 req-634b3681-aa9c-4c9d-b8ad-b51ba55b35a1 tempest-AttachVolumeTestJSON-1730628854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-b37d289c-e131-4034-b668-a5e6b3288e59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a42e65c-9f1f-46ca-bbc5-9ac20736b06f', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:26:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-f78a1629-d186-4902-8781-c569b6306852 req-634b3681-aa9c-4c9d-b8ad-b51ba55b35a1 tempest-AttachVolumeTestJSON-1730628854 None] attachment_update completed successfully. Sep 30 10:26:44 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Flow 'volume_create_manager' (d7084ee6-e0ad-46f6-a384-d2b9eb2deaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57a7532-0c79-4546-8010-8e7823d338c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57a7532-0c79-4546-8010-8e7823d338c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-374990731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2184d249-facd-4e63-8275-62c8c8789d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87021675d32d46a6a59f6a04e5dc1637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:45Z,use_quota=True,user_id='ababaee480244e71bf87e988f460b7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3872a5-d757-4cd4-bc38-80e0c02389c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3872a5-d757-4cd4-bc38-80e0c02389c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5350f476-5c47-4666-8510-731bd58d264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5350f476-5c47-4666-8510-731bd58d264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2184d249-facd-4e63-8275-62c8c8789d3b', 'volume_name': 'volume-2184d249-facd-4e63-8275-62c8c8789d3b', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c6cf12-eb3e-4fb9-bedb-35b2eb680daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c6cf12-eb3e-4fb9-bedb-35b2eb680daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52f9a3d-1c78-4ee6-ac71-bdcce9de3477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:45 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Volume 2184d249-facd-4e63-8275-62c8c8789d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2184d249-facd-4e63-8275-62c8c8789d3b', 'volume_size': 1} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-374990731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2184d249-facd-4e63-8275-62c8c8789d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87021675d32d46a6a59f6a04e5dc1637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:45Z,use_quota=True,user_id='ababaee480244e71bf87e988f460b7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Creating volume 2184d249-facd-4e63-8275-62c8c8789d3b {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:45 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:45 devstack sudo[91849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b 1073741824 Sep 30 10:26:45 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:45 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b 1073741824" returned: 0 in 0.768s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:45 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b Sep 30 10:26:45 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:46 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b" returned: 0 in 0.386s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52f9a3d-1c78-4ee6-ac71-bdcce9de3477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2184d249-facd-4e63-8275-62c8c8789d3b', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a55bf0-2d87-4e61-8722-9a999e3af150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:46 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Volume volume-2184d249-facd-4e63-8275-62c8c8789d3b (2184d249-facd-4e63-8275-62c8c8789d3b): created successfully Sep 30 10:26:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a55bf0-2d87-4e61-8722-9a999e3af150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Flow 'volume_create_manager' (d7084ee6-e0ad-46f6-a384-d2b9eb2deaf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:46 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e75e943e-0514-4261-a736-865386247f25 tempest-VolumesListAdminTestJSON-1615660679 None] Created volume successfully. Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Flow 'volume_create_manager' (493a2274-3365-42ac-914a-c8114fbe4a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994f831e-3dd6-4df6-a419-48e87cc1d903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994f831e-3dd6-4df6-a419-48e87cc1d903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-644797424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b590f7e9-44f1-4ca1-9704-bc8d9d5d638e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d94e389e4334c648d189d3afcfb22a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:47Z,use_quota=True,user_id='411037e8da24488e98d293b2262e049a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b18d31c-bd14-41b0-ba4c-fd0e4826d726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b18d31c-bd14-41b0-ba4c-fd0e4826d726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134f90db-003e-4c7a-8cb4-0e8ef0067563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134f90db-003e-4c7a-8cb4-0e8ef0067563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b590f7e9-44f1-4ca1-9704-bc8d9d5d638e', 'volume_name': 'volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad50c13-3052-406e-9043-c315c59a1276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad50c13-3052-406e-9043-c315c59a1276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2cf008-799f-42ea-9e50-7959e34d0360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:47 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Volume b590f7e9-44f1-4ca1-9704-bc8d9d5d638e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e', 'volume_size': 1} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-644797424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b590f7e9-44f1-4ca1-9704-bc8d9d5d638e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d94e389e4334c648d189d3afcfb22a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:47Z,use_quota=True,user_id='411037e8da24488e98d293b2262e049a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Creating volume b590f7e9-44f1-4ca1-9704-bc8d9d5d638e {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:47 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:47 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e 1073741824 Sep 30 10:26:47 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Flow 'volume_create_manager' (2d8fef3a-3845-46c0-9e49-4403c5b174d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1403d488-fd8f-4de5-a24e-d297d599aaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1403d488-fd8f-4de5-a24e-d297d599aaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1137517020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bded6963-ac61-4137-bb83-92016e8d08a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87021675d32d46a6a59f6a04e5dc1637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:47Z,use_quota=True,user_id='ababaee480244e71bf87e988f460b7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aff3b44-d8d9-408c-81ad-9a4c0fbb1a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aff3b44-d8d9-408c-81ad-9a4c0fbb1a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (942d9af7-4fc8-478c-a1de-a1b7663d791c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (942d9af7-4fc8-478c-a1de-a1b7663d791c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bded6963-ac61-4137-bb83-92016e8d08a3', 'volume_name': 'volume-bded6963-ac61-4137-bb83-92016e8d08a3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9ce6d6-a1ef-4716-aa5e-6e1b1a6adf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9ce6d6-a1ef-4716-aa5e-6e1b1a6adf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6a2c67-8b3a-4c2d-95c1-98a4ccbb2271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:47 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Volume bded6963-ac61-4137-bb83-92016e8d08a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bded6963-ac61-4137-bb83-92016e8d08a3', 'volume_size': 1} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:47 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e 1073741824" returned: 0 in 0.612s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:48 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e Sep 30 10:26:48 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:48 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e" returned: 0 in 0.320s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1137517020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bded6963-ac61-4137-bb83-92016e8d08a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87021675d32d46a6a59f6a04e5dc1637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:47Z,use_quota=True,user_id='ababaee480244e71bf87e988f460b7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Creating volume bded6963-ac61-4137-bb83-92016e8d08a3 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:48 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2cf008-799f-42ea-9e50-7959e34d0360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6964c4-2346-4731-854b-d771810292c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:48 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3 1073741824 Sep 30 10:26:48 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:48 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Volume volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e (b590f7e9-44f1-4ca1-9704-bc8d9d5d638e): created successfully Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6964c4-2346-4731-854b-d771810292c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Flow 'volume_create_manager' (493a2274-3365-42ac-914a-c8114fbe4a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:48 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-60585fc1-1f31-4295-9ecc-a2df3292c49b tempest-AttachVolumeTestJSON-1730628854 None] Created volume successfully. Sep 30 10:26:49 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3 1073741824" returned: 0 in 0.728s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:49 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3 Sep 30 10:26:49 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:49 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3" returned: 0 in 0.333s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6a2c67-8b3a-4c2d-95c1-98a4ccbb2271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bded6963-ac61-4137-bb83-92016e8d08a3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241b8468-60df-4cc0-9cf0-8e0f954f46c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:49 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Volume volume-bded6963-ac61-4137-bb83-92016e8d08a3 (bded6963-ac61-4137-bb83-92016e8d08a3): created successfully Sep 30 10:26:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241b8468-60df-4cc0-9cf0-8e0f954f46c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Flow 'volume_create_manager' (2d8fef3a-3845-46c0-9e49-4403c5b174d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:49 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e6118f1b-5163-4875-8027-3e52e3af54a8 tempest-VolumesListAdminTestJSON-1615660679 None] Created volume successfully. Sep 30 10:26:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-b0341130-5571-48c2-9f33-cf6295d7f81b req-e769a480-d85f-432d-aba6-076132de1c07 tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-b0341130-5571-48c2-9f33-cf6295d7f81b req-e769a480-d85f-432d-aba6-076132de1c07 tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-b0341130-5571-48c2-9f33-cf6295d7f81b req-e769a480-d85f-432d-aba6-076132de1c07 tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-b0341130-5571-48c2-9f33-cf6295d7f81b req-e769a480-d85f-432d-aba6-076132de1c07 tempest-AttachVolumeTestJSON-1730628854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b00a86e-1f2b-4afa-ab4a-6098d93d4a46', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:26:50 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-b0341130-5571-48c2-9f33-cf6295d7f81b req-e769a480-d85f-432d-aba6-076132de1c07 tempest-AttachVolumeTestJSON-1730628854 None] attachment_update completed successfully. Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Flow 'volume_create_manager' (8c315203-21aa-4bcb-91ac-e7d91a429708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7e3d9c-3513-4ef2-9dd3-635e7aa1d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7e3d9c-3513-4ef2-9dd3-635e7aa1d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a49695de-ea0a-4a46-8a35-cfd70ec4084b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454fd4e92e40469dbede013d5e48e5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:52Z,use_quota=True,user_id='2ccc080dd44e44e986d74dd42ccd85eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b55c37-1fd3-43f3-99f5-43faed2a2fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b55c37-1fd3-43f3-99f5-43faed2a2fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b60521-b2de-47a9-a872-cce66f0e57ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b60521-b2de-47a9-a872-cce66f0e57ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a49695de-ea0a-4a46-8a35-cfd70ec4084b', 'volume_name': 'volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db6c2f0-255c-4a08-8ef6-0e3e3883093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db6c2f0-255c-4a08-8ef6-0e3e3883093b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a47a21-e8f9-4ea6-b64e-2ddb17961f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:52 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Volume a49695de-ea0a-4a46-8a35-cfd70ec4084b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b', 'volume_size': 1} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a49695de-ea0a-4a46-8a35-cfd70ec4084b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454fd4e92e40469dbede013d5e48e5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:52Z,use_quota=True,user_id='2ccc080dd44e44e986d74dd42ccd85eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Creating volume a49695de-ea0a-4a46-8a35-cfd70ec4084b {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:52 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-26665777-91e9-4dca-b06d-8edd347763d1 tempest-GroupsV314Test-1495823260 None] Group tempest-GroupsV314Test-Group-845561973: creating Sep 30 10:26:52 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b 1073741824 Sep 30 10:26:52 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-26665777-91e9-4dca-b06d-8edd347763d1 tempest-GroupsV314Test-1495823260 None] Group tempest-GroupsV314Test-Group-845561973: created successfully Sep 30 10:26:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-26665777-91e9-4dca-b06d-8edd347763d1 tempest-GroupsV314Test-1495823260 None] Create group completed successfully. Sep 30 10:26:52 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b 1073741824" returned: 0 in 0.543s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:52 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b Sep 30 10:26:52 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:53 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b" returned: 0 in 0.274s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a47a21-e8f9-4ea6-b64e-2ddb17961f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ba0066-c576-451c-8b94-b15e7fc2e093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:53 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Volume volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b (a49695de-ea0a-4a46-8a35-cfd70ec4084b): created successfully Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ba0066-c576-451c-8b94-b15e7fc2e093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Flow 'volume_create_manager' (8c315203-21aa-4bcb-91ac-e7d91a429708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:53 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-412891e8-a2fe-4c15-9c04-2fd47f2e66e3 tempest-VolumesListAdminTestJSON-1590520499 None] Created volume successfully. Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Flow 'volume_create_manager' (3487767f-7265-4068-8582-2a3fe2f4bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a3679e-9c54-423e-a3e3-359f2f0f8cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a3679e-9c54-423e-a3e3-359f2f0f8cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1893368809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b4b5941-90e1-4ec5-823b-6a6de40bf006,host='devstack@QuobyteHD#QuobyteHD',id=049fb64a-5049-409f-aabd-28092c32d946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae895b9d83b4c54b98ba4cec8193cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:54Z,use_quota=True,user_id='332a984aacab454285e30407d8846c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e82ddd1-0660-49c3-87e4-d5527e415bd2),volume_type_id=0e82ddd1-0660-49c3-87e4-d5527e415bd2)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c1fe38-08da-4338-b23f-8b938cfeb96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c1fe38-08da-4338-b23f-8b938cfeb96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451be278-01e6-4004-8961-f479247662fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451be278-01e6-4004-8961-f479247662fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049fb64a-5049-409f-aabd-28092c32d946', 'volume_name': 'volume-049fb64a-5049-409f-aabd-28092c32d946', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968e3252-3ad7-42f4-a258-ef6cddc8e559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968e3252-3ad7-42f4-a258-ef6cddc8e559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e16f38-eb95-49de-90bc-df59f878f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:53 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Volume 049fb64a-5049-409f-aabd-28092c32d946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049fb64a-5049-409f-aabd-28092c32d946', 'volume_size': 1} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2b4b5941-90e1-4ec5-823b-6a6de40bf006,created_at=2026-09-30T08:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1893368809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b4b5941-90e1-4ec5-823b-6a6de40bf006,host='devstack@QuobyteHD#QuobyteHD',id=049fb64a-5049-409f-aabd-28092c32d946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae895b9d83b4c54b98ba4cec8193cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:26:54Z,use_quota=True,user_id='332a984aacab454285e30407d8846c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e82ddd1-0660-49c3-87e4-d5527e415bd2),volume_type_id=0e82ddd1-0660-49c3-87e4-d5527e415bd2)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Creating volume 049fb64a-5049-409f-aabd-28092c32d946 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:26:53 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:53 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 1073741824 Sep 30 10:26:53 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:53 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-a717cba7-69ac-4d7c-9ee2-fc1c694d63b1 req-1027b871-03d1-4f90-9d52-7cb7c2f8bbb3 tempest-AttachVolumeTestJSON-1730628854 None] Terminate volume connection completed successfully. Sep 30 10:26:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-a717cba7-69ac-4d7c-9ee2-fc1c694d63b1 req-1027b871-03d1-4f90-9d52-7cb7c2f8bbb3 tempest-AttachVolumeTestJSON-1730628854 None] Deleting attachment 9a42e65c-9f1f-46ca-bbc5-9ac20736b06f. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Acquiring lock "cinder-a49695de-ea0a-4a46-8a35-cfd70ec4084b-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Lock "cinder-a49695de-ea0a-4a46-8a35-cfd70ec4084b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Acquiring lock "cinder-quobyte-a49695de-ea0a-4a46-8a35-cfd70ec4084b" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Lock "cinder-quobyte-a49695de-ea0a-4a46-8a35-cfd70ec4084b" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b4f0b9-77cb-4f79-88ba-59b4a720f6ec]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "cinder-bded6963-ac61-4137-bb83-92016e8d08a3-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-bded6963-ac61-4137-bb83-92016e8d08a3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:54 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Acquiring lock "cinder-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "cinder-quobyte-bded6963-ac61-4137-bb83-92016e8d08a3" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 1073741824" returned: 0 in 0.775s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-quobyte-bded6963-ac61-4137-bb83-92016e8d08a3" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:54 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b Sep 30 10:26:54 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Lock "cinder-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e665b88-e94b-4f95-addf-feea430a5fd2]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:54 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 Sep 30 10:26:54 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Acquiring lock "cinder-quobyte-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Lock "cinder-quobyte-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eff779a-1a86-4f44-9fa2-d9b624447621]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:54 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3 Sep 30 10:26:54 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:55 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b" returned: 0 in 0.561s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:55 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab Sep 30 10:26:55 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b Sep 30 10:26:55 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:55 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:55 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946" returned: 0 in 0.442s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e16f38-eb95-49de-90bc-df59f878f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049fb64a-5049-409f-aabd-28092c32d946', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1b0e75-f892-4331-b5b9-e7462e8dd3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:26:55 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Volume volume-049fb64a-5049-409f-aabd-28092c32d946 (049fb64a-5049-409f-aabd-28092c32d946): created successfully Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1b0e75-f892-4331-b5b9-e7462e8dd3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Flow 'volume_create_manager' (3487767f-7265-4068-8582-2a3fe2f4bfad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:26:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-31c92352-126a-4ff7-8e22-0d377e84a9cb tempest-GroupsV314Test-1495823260 None] Created volume successfully. Sep 30 10:26:55 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3" returned: 0 in 0.599s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:55 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3 Sep 30 10:26:55 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:55 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a49695de-ea0a-4a46-8a35-cfd70ec4084b" returned: 0 in 0.357s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Lock "cinder-quobyte-a49695de-ea0a-4a46-8a35-cfd70ec4084b" released by "delete_volume" :: held 0.981s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:55 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab" returned: 0 in 0.584s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Created reservations ['090f67cd-67b2-4c05-8d42-057924ef44ed', '5eca5694-e53e-4fcb-a1c7-e4a16b571039', '0889a14a-c720-4c18-861f-fe522c94fcfa', 'abedb6c6-379f-4685-9f39-500afe0b6ca8'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:55 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab Sep 30 10:26:55 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:55 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:55 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:55 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bded6963-ac61-4137-bb83-92016e8d08a3" returned: 0 in 0.319s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-quobyte-bded6963-ac61-4137-bb83-92016e8d08a3" released by "delete_volume" :: held 1.022s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-a3433b33-b306-4ba2-95c0-eeb17108f6af req-5303fc16-c847-4c67-a68e-3d5ab37714e7 tempest-AttachVolumeTestJSON-1730628854 None] Terminate volume connection completed successfully. Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-a3433b33-b306-4ba2-95c0-eeb17108f6af req-5303fc16-c847-4c67-a68e-3d5ab37714e7 tempest-AttachVolumeTestJSON-1730628854 None] Deleting attachment 0b00a86e-1f2b-4afa-ab4a-6098d93d4a46. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Created reservations ['0185ba9f-2057-4937-842e-a85e088b42c8', '64d4d4ba-5e03-42d1-ba4a-4d23bb7212bc', '9ab77014-f9e5-4c86-af93-8ba891520e05', '431920e6-88dd-4fdb-956a-3f000538a65f'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:55 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab" returned: 0 in 0.405s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Lock "cinder-quobyte-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab" released by "delete_volume" :: held 1.068s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:55 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.367s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:55 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Deleted volume successfully. Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Created reservations ['9071490d-7cb4-4922-90c6-911792743439', '90b018b4-6625-4c35-9d1f-2eda27df5f8c', '6275ccfe-d267-4bee-acee-5511c8e5f2c2', '6693677d-5b99-4f71-8fb5-71fb44de7db7'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:56 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:56 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e572ee56-22f4-436f-ac68-a7894eda0faf tempest-VolumesListAdminTestJSON-1590520499 None] Lock "cinder-a49695de-ea0a-4a46-8a35-cfd70ec4084b-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:56 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:56 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:56 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.336s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Deleted volume successfully. Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-be61dd5b-39b3-4b98-9760-5aa4da6a232a tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-bded6963-ac61-4137-bb83-92016e8d08a3-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:56 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.322s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Deleted volume successfully. Sep 30 10:26:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cbce0379-e86c-437d-a3d8-38edd0246acb tempest-TaggedAttachmentsTest-270231986 None] Lock "cinder-6fc3dca3-d8b0-47b8-a27e-a7ba29a9dcab-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "cinder-2184d249-facd-4e63-8275-62c8c8789d3b-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:57 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Cloning volume 049fb64a-5049-409f-aabd-28092c32d946 to volume 71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-2184d249-facd-4e63-8275-62c8c8789d3b-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Creating offline snapshot 3bdcfdea-1f22-40db-908e-2fbe3f915dbf of volume 049fb64a-5049-409f-aabd-28092c32d946 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "cinder-quobyte-2184d249-facd-4e63-8275-62c8c8789d3b" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-quobyte-2184d249-facd-4e63-8275-62c8c8789d3b" acquired by "delete_volume" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d68dd08-2e2f-4e15-ba53-f6a71e207aa5]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58ce7ef-adec-447c-a049-5857dc32880a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:57 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 Sep 30 10:26:57 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:57 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b Sep 30 10:26:57 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:57 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946" returned: 0 in 0.629s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:57 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b" returned: 0 in 0.618s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:57 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf 1G Sep 30 10:26:57 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:57 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b Sep 30 10:26:57 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:58 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2184d249-facd-4e63-8275-62c8c8789d3b" returned: 0 in 0.414s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-quobyte-2184d249-facd-4e63-8275-62c8c8789d3b" released by "delete_volume" :: held 1.119s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Created reservations ['5f9c3039-1c61-4e7e-a136-c67398bf6289', '74ba11c0-2586-4293-863c-cfa4dbd2de5a', '568b1b28-a81f-42ed-a582-f6b452a06b33', '46602399-0f3b-42d9-b187-096aafece258'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:26:58 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf 1G" returned: 0 in 0.630s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-049fb64a-5049-409f-aabd-28092c32d946 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:26:58 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-049fb64a-5049-409f-aabd-28092c32d946 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:26:58 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:58 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:26:58 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:58 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.371s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:58 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:26:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Deleted volume successfully. Sep 30 10:26:58 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-049fb64a-5049-409f-aabd-28092c32d946 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf" returned: 0 in 0.432s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:59 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-abc70bc7-da92-4852-8304-19dbb8b980b3 tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-2184d249-facd-4e63-8275-62c8c8789d3b-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:26:59 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf Sep 30 10:26:59 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:59 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf" returned: 0 in 0.248s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:59 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.info Sep 30 10:26:59 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "cinder-2923b103-6c7a-406f-9ddf-c1137a61d0b5-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-2923b103-6c7a-406f-9ddf-c1137a61d0b5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "cinder-quobyte-2923b103-6c7a-406f-9ddf-c1137a61d0b5" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-quobyte-2923b103-6c7a-406f-9ddf-c1137a61d0b5" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:26:59 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.info" returned: 0 in 0.359s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:26:59 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[301118a1-9cee-4122-98f5-c1d0d859b353]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:26:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:26:59 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.info Sep 30 10:26:59 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:26:59 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5 Sep 30 10:26:59 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:00 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.info" returned: 0 in 0.356s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Acquiring lock "cinder-quobyte-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Lock "cinder-quobyte-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] snapshot: 3bdcfdea-1f22-40db-908e-2fbe3f915dbf, volume: 71e0886d-9e8a-41a4-9ad4-b4a837ad7e37, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc82201b-1db4-46ee-91a5-c6e0220b444a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:00 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5" returned: 0 in 0.476s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:00 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5 Sep 30 10:27:00 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:00 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf Sep 30 10:27:00 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:00 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2923b103-6c7a-406f-9ddf-c1137a61d0b5" returned: 0 in 0.433s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-quobyte-2923b103-6c7a-406f-9ddf-c1137a61d0b5" released by "delete_volume" :: held 0.992s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Created reservations ['b9956c42-f27e-4559-999c-0edc11f6c6ff', '43ee927a-b785-4ace-af88-a3acd6a8935f', '9f7580f2-c9ce-4f9e-9446-1831ef79845f', '5d8b6d15-b19f-4d62-bbb2-43498c458b6c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:00 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf" returned: 0 in 0.616s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-049fb64a-5049-409f-aabd-28092c32d946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b5b211-8283-4c5b-a6e0-b06fd5792fef]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:00 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:27:00 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:00 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 Sep 30 10:27:00 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:01 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.358s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:01 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:27:01 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Deleted volume successfully. Sep 30 10:27:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39726b99-2f19-4d41-a539-270f38d4053d tempest-VolumesListAdminTestJSON-1615660679 None] Lock "cinder-2923b103-6c7a-406f-9ddf-c1137a61d0b5-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:01 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946" returned: 0 in 0.529s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:27:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:27:01 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:27:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:01 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 Sep 30 10:27:01 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "cinder-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "cinder-quobyte-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-quobyte-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e" acquired by "delete_volume" :: waited 0.039s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:03 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4537e5de-fd8c-46f1-b0e8-c7d5d2654b6b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:04 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e Sep 30 10:27:04 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:04 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e" returned: 0 in 0.818s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:04 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e Sep 30 10:27:04 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:05 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e" returned: 0 in 0.715s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-quobyte-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e" released by "delete_volume" :: held 1.651s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:05 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Created reservations ['022e279c-85f1-447b-bcee-8374a24a9a35', 'e7cf069b-f187-45a8-97ec-e907b0acb8ad', 'a48d6a1f-8f20-4328-bc3a-72402496d2a5', '43ab4f54-0610-43b0-b26a-af65df899c09'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:05 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:27:05 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "cinder-b37d289c-e131-4034-b668-a5e6b3288e59-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-b37d289c-e131-4034-b668-a5e6b3288e59-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:06 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.592s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:06 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:27:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Deleted volume successfully. Sep 30 10:27:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "cinder-quobyte-b37d289c-e131-4034-b668-a5e6b3288e59" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-106ac64c-ffc2-41d9-83be-41054945f8b9 tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-b590f7e9-44f1-4ca1-9704-bc8d9d5d638e-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-quobyte-b37d289c-e131-4034-b668-a5e6b3288e59" acquired by "delete_volume" :: waited 0.045s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:06 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b4085c-032f-4e3d-b987-d9ba3459f0f8]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:06 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59 Sep 30 10:27:06 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:07 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59" returned: 0 in 1.093s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:07 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59 Sep 30 10:27:07 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:08 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b37d289c-e131-4034-b668-a5e6b3288e59" returned: 0 in 0.853s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-quobyte-b37d289c-e131-4034-b668-a5e6b3288e59" released by "delete_volume" :: held 2.059s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:08 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Created reservations ['f759cd3c-9f23-4711-a7b7-70a67c175c00', '4a9ab3a9-5f78-40c4-9dd5-ad1d8dadcc3b', 'a76f89b7-6802-41be-895e-6421227bed6d', '230c7b4d-119a-46a2-af0f-58b16dcda413'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:08 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:27:08 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "cinder-43094020-fb4a-40bd-b9b4-82c197459384-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:09 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.523s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:09 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:27:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-43094020-fb4a-40bd-b9b4-82c197459384-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:09 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Deleted volume successfully. Sep 30 10:27:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-34b6a276-02a9-4c52-a340-78dbb8ef8b5c tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-b37d289c-e131-4034-b668-a5e6b3288e59-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "cinder-quobyte-43094020-fb4a-40bd-b9b4-82c197459384" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-quobyte-43094020-fb4a-40bd-b9b4-82c197459384" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:09 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24b650-2e68-473a-bedf-9d00b4fc8d67]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:09 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384 Sep 30 10:27:09 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:10 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384" returned: 0 in 0.794s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:10 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384 Sep 30 10:27:10 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:10 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-43094020-fb4a-40bd-b9b4-82c197459384" returned: 0 in 0.683s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-quobyte-43094020-fb4a-40bd-b9b4-82c197459384" released by "delete_volume" :: held 1.589s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Created reservations ['6a7a39c0-14cb-497b-9a96-0994527ab613', '6edd8d3a-2a86-4fcf-ae25-e6fcd03f8686', '357a2fe8-bb26-4e9a-8cb5-1d07537f16f7', '56aebe4f-a8bf-4470-94ce-8cf56f15a5b1'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:11 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37" returned: 0 in 9.845s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946, size 1024.00 MB, duration 9.85 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:27:11 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Converted 1024.00 MB image at 103.97 MB/s Sep 30 10:27:11 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:11 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 Sep 30 10:27:11 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:11 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:27:11 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:11 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37" returned: 0 in 0.289s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Lock "cinder-quobyte-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37" released by "_copy_volume_from_snapshot" :: held 11.407s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Acquiring lock "cinder-quobyte-3bdcfdea-1f22-40db-908e-2fbe3f915dbf" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Lock "cinder-quobyte-3bdcfdea-1f22-40db-908e-2fbe3f915dbf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Deleting offline snapshot 3bdcfdea-1f22-40db-908e-2fbe3f915dbf of volume 049fb64a-5049-409f-aabd-28092c32d946 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] snapshot_file for this snap is: volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[122a0756-e03a-42c0-a37e-572c393030b4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:11 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.342s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:27:11 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Deleted volume successfully. Sep 30 10:27:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7329b30d-e497-4313-bce7-84946fb2dabf tempest-AttachVolumeTestJSON-1730628854 None] Lock "cinder-43094020-fb4a-40bd-b9b4-82c197459384-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:11 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf Sep 30 10:27:11 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:12 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf" returned: 0 in 0.496s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-049fb64a-5049-409f-aabd-28092c32d946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9147669-9433-4584-a91d-9f641d35b5f0]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:12 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 Sep 30 10:27:12 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Flow 'volume_create_manager' (4250703e-2195-424e-9231-52ae7c6abd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ccf787-6663-4f75-a95d-9006f3d4e8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ccf787-6663-4f75-a95d-9006f3d4e8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-726780304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af19f847-405e-4e38-8778-8160230ea782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e453bf6bb6143318f86ac0fd18497e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:27:13Z,use_quota=True,user_id='419620a4ae38403ea6d81a71f753cc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc4cbab-76fa-45f8-8f05-bdf7171cb7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc4cbab-76fa-45f8-8f05-bdf7171cb7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019adf53-341a-4b7c-b547-2c461a75ce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG cinder.image.glance [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Creating Keystone auth plugin from conf {{(pid=87013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 10:27:12 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946" returned: 0 in 0.755s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:12 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf Sep 30 10:27:12 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019adf53-341a-4b7c-b547-2c461a75ce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af19f847-405e-4e38-8778-8160230ea782', 'volume_name': 'volume-af19f847-405e-4e38-8778-8160230ea782', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c0d6b1-5a91-4673-8ed4-05e8da4f6760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c0d6b1-5a91-4673-8ed4-05e8da4f6760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e094b6af-3697-4e1e-85b9-0b6d98d74e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:13 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Volume af19f847-405e-4e38-8778-8160230ea782: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af19f847-405e-4e38-8778-8160230ea782', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Trying to clone af19f847-405e-4e38-8778-8160230ea782 from image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]). {{(pid=87013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 10:27:13 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf" returned: 0 in 0.503s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:13 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf Sep 30 10:27:13 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:13 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946.3bdcfdea-1f22-40db-908e-2fbe3f915dbf" returned: 0 in 0.405s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Lock "cinder-quobyte-3bdcfdea-1f22-40db-908e-2fbe3f915dbf" released by "_delete_snapshot" :: held 2.333s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 10:27:13 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Image download 20.69 MB at 20.69 MB/s Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.828s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6308606c-b09e-48ad-9f33-47a0dfefac5b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:14 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e13c72f4-f53a-4a75-98bf-eba9760ecc92 tempest-GroupsV314Test-1495823260 None] Create group from source-group-2b4b5941-90e1-4ec5-823b-6a6de40bf006 completed successfully. Sep 30 10:27:14 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD Sep 30 10:27:14 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:14 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Temporary image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e is fetched for user 419620a4ae38403ea6d81a71f753cc41. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b378d7-565f-4457-a086-d94fab2b0c06]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:14 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD Sep 30 10:27:14 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:14 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-726780304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af19f847-405e-4e38-8778-8160230ea782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e453bf6bb6143318f86ac0fd18497e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:27:13Z,use_quota=True,user_id='419620a4ae38403ea6d81a71f753cc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Creating volume af19f847-405e-4e38-8778-8160230ea782 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:27:14 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:27:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:14 devstack sudo[92594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 1073741824 Sep 30 10:27:14 devstack sudo[92594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Acquiring lock "cinder-quobyte-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Lock "cinder-quobyte-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e45f27-662f-4777-a1fd-929ff753b21c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:15 devstack sudo[92594]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 1073741824" returned: 0 in 0.603s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:15 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 Sep 30 10:27:15 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:15 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 Sep 30 10:27:15 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:15 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37" returned: 0 in 0.440s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:15 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782" returned: 0 in 0.288s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:15 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37 Sep 30 10:27:15 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Attempting download of 0e96b9f2-4ae9-48ec-8d88-8e11a591034e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}])) to volume af19f847-405e-4e38-8778-8160230ea782. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8695f69a-0d50-4d5f-ad95-267b3646ae91]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_p1t33m2s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:16 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_p1t33m2s Sep 30 10:27:16 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37" returned: 0 in 0.400s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:16 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Lock "cinder-quobyte-71e0886d-9e8a-41a4-9ad4-b4a837ad7e37" released by "delete_volume" :: held 0.920s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Created reservations ['3624576b-70ac-4e22-b91c-3a8e476a7373'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:16 devstack cinder-volume[87013]: WARNING cinder.quota [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1299071537 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1299071537, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:27:16 devstack cinder-volume[87013]: WARNING cinder.quota [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1299071537 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1299071537, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Created reservations ['3fce298f-9801-4781-8d68-c38f23cc20ab', 'dea0a95a-298d-4d06-8bc6-89ac0eb37b35', '45937c6d-00d1-4b99-b682-2bcaf67ed4ef', 'c25dbaeb-1e3a-4d87-9c61-2c0279e76e3d'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:16 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_p1t33m2s" returned: 0 in 0.475s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_p1t33m2s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:16 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:27:16 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:16 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_p1t33m2s Sep 30 10:27:16 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:16 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.321s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:27:16 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-370f8bee-3770-494e-9cda-0a29086a5fa4 tempest-GroupsV314Test-1495823260 None] Delete group completed successfully. Sep 30 10:27:16 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_p1t33m2s" returned: 1 in 0.443s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_p1t33m2s' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[876ce7cc-6d63-4929-be39-391b08521820]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Acquiring lock "cinder-quobyte-049fb64a-5049-409f-aabd-28092c32d946" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Lock "cinder-quobyte-049fb64a-5049-409f-aabd-28092c32d946" acquired by "delete_volume" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:17 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD Sep 30 10:27:17 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b02b5f-b89a-4fa7-8f5c-84f15b287191]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:17 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 Sep 30 10:27:17 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:17 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] 0e96b9f2-4ae9-48ec-8d88-8e11a591034e was qcow2, converting to qcow2 {{(pid=87013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:17 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 Sep 30 10:27:17 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:17 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946" returned: 0 in 0.471s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:17 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946 Sep 30 10:27:17 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:17 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-049fb64a-5049-409f-aabd-28092c32d946" returned: 0 in 0.337s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Lock "cinder-quobyte-049fb64a-5049-409f-aabd-28092c32d946" released by "delete_volume" :: held 0.917s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:18 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Created reservations ['ef04e530-20c8-48b3-a0de-2eedba266948'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:18 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Created reservations ['65fcb370-fc1e-4f7c-8635-b2ec604648f2', '17bda358-55d0-4c3e-8e62-1f6cc5e7f711', 'b289702f-ea07-4d2a-8026-9e5dd3dd2a14', 'ae9ffc27-a285-409e-9565-1544a8033977'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:18 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:27:18 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:18 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.351s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:18 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:27:18 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e56f4373-2418-4e49-9044-3469deec9c14 tempest-GroupsV314Test-1495823260 None] Delete group completed successfully. Sep 30 10:27:20 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782" returned: 0 in 2.790s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q2bcqvtxdevstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:27:20 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Converted 112.00 MB image at 40.13 MB/s Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:20 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 1G Sep 30 10:27:20 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:20 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 1G" returned: 0 in 0.383s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Downloaded image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}])) to volume af19f847-405e-4e38-8778-8160230ea782 successfully. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Temporary image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e for user 419620a4ae38403ea6d81a71f753cc41 is deleted. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Marking volume af19f847-405e-4e38-8778-8160230ea782 as bootable. {{(pid=87013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Copying metadata from image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e to af19f847-405e-4e38-8778-8160230ea782. {{(pid=87013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Creating volume glance metadata for volume af19f847-405e-4e38-8778-8160230ea782 backed by image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e094b6af-3697-4e1e-85b9-0b6d98d74e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af19f847-405e-4e38-8778-8160230ea782', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017232a5-690d-48d2-b483-ad2823d64ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:20 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Volume volume-af19f847-405e-4e38-8778-8160230ea782 (af19f847-405e-4e38-8778-8160230ea782): created successfully Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017232a5-690d-48d2-b483-ad2823d64ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Flow 'volume_create_manager' (4250703e-2195-424e-9231-52ae7c6abd55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:27:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-69872274-4a7f-478e-b90e-ae2f5795f4d3 tempest-VolumesImageMetadata-695282215 None] Created volume successfully. Sep 30 10:27:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Acquiring lock "cinder-af19f847-405e-4e38-8778-8160230ea782-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Lock "cinder-af19f847-405e-4e38-8778-8160230ea782-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Acquiring lock "cinder-quobyte-af19f847-405e-4e38-8778-8160230ea782" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Lock "cinder-quobyte-af19f847-405e-4e38-8778-8160230ea782" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:22 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2c61a4-e103-44b7-a322-38f3bb653fe1]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:22 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 Sep 30 10:27:22 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:22 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782" returned: 0 in 0.462s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:22 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782 Sep 30 10:27:22 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:23 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-af19f847-405e-4e38-8778-8160230ea782" returned: 0 in 0.272s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Lock "cinder-quobyte-af19f847-405e-4e38-8778-8160230ea782" released by "delete_volume" :: held 0.793s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Created reservations ['ddd4b566-121c-4f3e-8da7-04b898462374', '28828239-137c-44c0-9cd2-2280f180fbe7', '5464042e-2c2e-4fe1-9c1b-611b4ed96398', 'ff10af96-acef-4bf3-9c6c-41e1aab1fcd3'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:23 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:27:23 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:23 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.297s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:27:23 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Deleted volume successfully. Sep 30 10:27:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a85f6b99-1258-4eda-8a3e-707ac2aaa1f4 tempest-VolumesImageMetadata-695282215 None] Lock "cinder-af19f847-405e-4e38-8778-8160230ea782-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:33 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=141,cinder:UPDATE=150,cinder:INSERT=36,cinder:DELETE=6 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:27:33 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=142,cinder:UPDATE=157,cinder:INSERT=44,cinder:DELETE=12 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:27:33 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Flow 'volume_create_manager' (52ece814-3964-4733-a1c1-c4cb82d4c99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85478a3-8c12-4078-8cd1-609ac1e9cb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85478a3-8c12-4078-8cd1-609ac1e9cb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1296342861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422bf055-8055-40dd-9e94-46ed3e162ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3690700c0d84651b95a136faa6e332a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:27:34Z,use_quota=True,user_id='24798bd3db4f44bf84fd59cbf7f48f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93db0c08-8fb2-4d23-8021-2faec3aa1fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93db0c08-8fb2-4d23-8021-2faec3aa1fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f47689-ceb2-4cec-a859-245e31c08a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f47689-ceb2-4cec-a859-245e31c08a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422bf055-8055-40dd-9e94-46ed3e162ab5', 'volume_name': 'volume-422bf055-8055-40dd-9e94-46ed3e162ab5', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a867dc63-d84b-47c0-b8d1-c883e96c7fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a867dc63-d84b-47c0-b8d1-c883e96c7fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7152bc43-636e-4904-a8f7-73b0e21c1635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:34 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Volume 422bf055-8055-40dd-9e94-46ed3e162ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422bf055-8055-40dd-9e94-46ed3e162ab5', 'volume_size': 1} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1296342861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422bf055-8055-40dd-9e94-46ed3e162ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3690700c0d84651b95a136faa6e332a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:27:34Z,use_quota=True,user_id='24798bd3db4f44bf84fd59cbf7f48f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Creating volume 422bf055-8055-40dd-9e94-46ed3e162ab5 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:27:34 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:34 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 1073741824 Sep 30 10:27:34 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:34 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 1073741824" returned: 0 in 0.534s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:34 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 Sep 30 10:27:34 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:35 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5" returned: 0 in 0.373s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:27:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7152bc43-636e-4904-a8f7-73b0e21c1635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422bf055-8055-40dd-9e94-46ed3e162ab5', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf5e94d-4ac3-4968-8cb3-145153a1b1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:35 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Volume volume-422bf055-8055-40dd-9e94-46ed3e162ab5 (422bf055-8055-40dd-9e94-46ed3e162ab5): created successfully Sep 30 10:27:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf5e94d-4ac3-4968-8cb3-145153a1b1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Flow 'volume_create_manager' (52ece814-3964-4733-a1c1-c4cb82d4c99a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:27:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b632f6ff-ce60-4945-9a4f-c8fe3b9e770f tempest-SnapshotMetadataTestJSON-228126826 None] Created volume successfully. Sep 30 10:27:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Creating offline snapshot 8809e5c0-fbf3-41c3-9d3a-98614b7304f9 of volume 422bf055-8055-40dd-9e94-46ed3e162ab5 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:27:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac32343-7cb2-4bf7-aa5c-c9648eb22bdb]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:36 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 Sep 30 10:27:36 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:36 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5" returned: 0 in 0.441s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:36 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 1G Sep 30 10:27:36 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:37 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:27:37 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:37 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.338s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 28 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:27:37 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 1G" returned: 0 in 0.705s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422bf055-8055-40dd-9e94-46ed3e162ab5 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:37 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422bf055-8055-40dd-9e94-46ed3e162ab5 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 Sep 30 10:27:37 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:38 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422bf055-8055-40dd-9e94-46ed3e162ab5 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9" returned: 0 in 0.458s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:38 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 is being set with open permissions: ugo+rw Sep 30 10:27:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:38 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 Sep 30 10:27:38 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:38 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9" returned: 0 in 0.324s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:38 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.info Sep 30 10:27:38 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:38 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.info" returned: 0 in 0.361s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:38 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.info is being set with open permissions: ugo+rw Sep 30 10:27:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:38 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.info Sep 30 10:27:38 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:39 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.info" returned: 0 in 0.373s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.844s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-61090087-d2b7-4ad4-bb5a-ed1c1aa0527f tempest-SnapshotMetadataTestJSON-228126826 None] Create snapshot completed successfully Sep 30 10:27:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Acquiring lock "cinder-8809e5c0-fbf3-41c3-9d3a-98614b7304f9-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "cinder-8809e5c0-fbf3-41c3-9d3a-98614b7304f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Acquiring lock "cinder-quobyte-422bf055-8055-40dd-9e94-46ed3e162ab5" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "cinder-quobyte-422bf055-8055-40dd-9e94-46ed3e162ab5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Acquiring lock "cinder-quobyte-8809e5c0-fbf3-41c3-9d3a-98614b7304f9" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "cinder-quobyte-8809e5c0-fbf3-41c3-9d3a-98614b7304f9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Deleting offline snapshot 8809e5c0-fbf3-41c3-9d3a-98614b7304f9 of volume 422bf055-8055-40dd-9e94-46ed3e162ab5 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:27:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] snapshot_file for this snap is: volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:27:41 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[08af13a2-4054-4496-b2e1-f470e5c76bee]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:41 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 Sep 30 10:27:41 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:42 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9" returned: 0 in 0.521s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-422bf055-8055-40dd-9e94-46ed3e162ab5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:27:42 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e262aff-3de3-49f4-b0e6-f8313c96c07e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:42 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 Sep 30 10:27:42 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5" returned: 0 in 0.550s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:42 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:42 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 Sep 30 10:27:42 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:43 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9" returned: 0 in 0.908s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:43 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9 Sep 30 10:27:43 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:44 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5.8809e5c0-fbf3-41c3-9d3a-98614b7304f9" returned: 0 in 0.524s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "cinder-quobyte-8809e5c0-fbf3-41c3-9d3a-98614b7304f9" released by "_delete_snapshot" :: held 2.756s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "cinder-quobyte-422bf055-8055-40dd-9e94-46ed3e162ab5" released by "delete_snapshot" :: held 2.801s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:44 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Created reservations ['0dd8ff56-77a3-4778-a0e3-4a11aaec5b73', '5f2bcc1c-0371-449f-b465-4b74b72345d7', '3e199711-1dbf-43e7-8af8-cdbd4dc38144', 'd667f4ed-a5d7-45c1-a0dd-dd49784b7411'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Delete snapshot completed successfully. Sep 30 10:27:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b4b1965a-608d-4c4e-93f5-28f8eecb95d4 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "cinder-8809e5c0-fbf3-41c3-9d3a-98614b7304f9-delete_snapshot" released by "delete_snapshot" :: held 3.063s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Acquiring lock "cinder-422bf055-8055-40dd-9e94-46ed3e162ab5-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "cinder-422bf055-8055-40dd-9e94-46ed3e162ab5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Acquiring lock "cinder-quobyte-422bf055-8055-40dd-9e94-46ed3e162ab5" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:27:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "cinder-quobyte-422bf055-8055-40dd-9e94-46ed3e162ab5" acquired by "delete_volume" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:27:45 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b371418-0244-4fff-98a5-d9a99c4b8f0c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:45 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 Sep 30 10:27:45 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:45 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5" returned: 0 in 0.411s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:45 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5 Sep 30 10:27:45 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:46 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-422bf055-8055-40dd-9e94-46ed3e162ab5" returned: 0 in 0.419s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "cinder-quobyte-422bf055-8055-40dd-9e94-46ed3e162ab5" released by "delete_volume" :: held 0.944s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Created reservations ['15971bdb-3d78-4238-b8f6-d7185d78d540', 'febc061c-3bc1-4999-ae47-1dfd30cb6e69', '404d10a0-5173-4457-8d1c-7df5e69d4ab9', '585f0da2-9d81-48e7-ba19-653e7bc90884'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:46 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:27:46 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:46 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.495s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:27:46 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Deleted volume successfully. Sep 30 10:27:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3ee89c9c-5c59-4a54-af68-2a27726f8263 tempest-SnapshotMetadataTestJSON-228126826 None] Lock "cinder-422bf055-8055-40dd-9e94-46ed3e162ab5-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Flow 'volume_create_manager' (b83a9722-4546-4dea-b9aa-14e76936ad74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a886eba-d5df-4af2-ab9d-7a1e34c97f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a886eba-d5df-4af2-ab9d-7a1e34c97f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-693161730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2bfcc0-75e2-49d2-b00d-5a5c825c2532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636f3f8faf5640658656cf0a1417e8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:27:56Z,use_quota=True,user_id='e3540908f2234285aeb93658d43ae3bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e94766-e51e-4337-acd1-33354cfebbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e94766-e51e-4337-acd1-33354cfebbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4e4e0-7b1f-496a-967a-708a1250e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4e4e0-7b1f-496a-967a-708a1250e288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2bfcc0-75e2-49d2-b00d-5a5c825c2532', 'volume_name': 'volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc8d035-f372-4d8d-907e-dbd63269bcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc8d035-f372-4d8d-907e-dbd63269bcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffba817-d98e-4dbd-ba4d-1df0501d2f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:56 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Volume fc2bfcc0-75e2-49d2-b00d-5a5c825c2532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532', 'volume_size': 1} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-693161730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2bfcc0-75e2-49d2-b00d-5a5c825c2532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636f3f8faf5640658656cf0a1417e8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:27:56Z,use_quota=True,user_id='e3540908f2234285aeb93658d43ae3bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Creating volume fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:27:56 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:27:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:56 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 1073741824 Sep 30 10:27:56 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:57 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 1073741824" returned: 0 in 0.825s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:57 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 Sep 30 10:27:57 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:57 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" returned: 0 in 0.406s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:27:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:27:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffba817-d98e-4dbd-ba4d-1df0501d2f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b670026-e9e7-44e3-88bb-ac1fe30f725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:27:57 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Volume volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 (fc2bfcc0-75e2-49d2-b00d-5a5c825c2532): created successfully Sep 30 10:27:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b670026-e9e7-44e3-88bb-ac1fe30f725d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:27:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Flow 'volume_create_manager' (b83a9722-4546-4dea-b9aa-14e76936ad74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:27:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-197018e8-6141-4d1c-827b-311b5b570e70 tempest-VolumesDeleteCascade-977645328 None] Created volume successfully. Sep 30 10:27:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:27:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:27:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Creating offline snapshot 750800cd-debd-42a0-bd54-86fdaf96b727 of volume fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:27:58 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7f018c-7e0b-4b6d-b750-660dcf86fa22]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:27:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:59 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 Sep 30 10:27:59 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:27:59 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Sep 30 10:27:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" returned: 0 in 0.563s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:27:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:27:59 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 1G Sep 30 10:27:59 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:00 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 1G" returned: 0 in 0.500s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:00 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 Sep 30 10:28:00 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:00 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727" returned: 0 in 0.338s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:00 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 is being set with open permissions: ugo+rw Sep 30 10:28:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:00 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 Sep 30 10:28:00 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:00 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727" returned: 0 in 0.293s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:00 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.info Sep 30 10:28:00 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:01 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.info" returned: 0 in 0.293s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:01 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.info is being set with open permissions: ugo+rw Sep 30 10:28:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:01 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.info Sep 30 10:28:01 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:01 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.info" returned: 0 in 0.251s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:01 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-50516530-0580-4201-8181-0b3834ed4c41 tempest-VolumesDeleteCascade-977645328 None] Create snapshot completed successfully Sep 30 10:28:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] Creating offline snapshot 79e9e144-0f65-445b-98a4-eed58e5a9089 of volume fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:28:02 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e912f606-8049-4ae7-a081-c1aeedf8bf92]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:02 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 Sep 30 10:28:02 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:02 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727" returned: 0 in 0.370s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:28:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:02 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 1G Sep 30 10:28:02 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:03 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 1G" returned: 0 in 0.498s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:03 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 Sep 30 10:28:03 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:03 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089" returned: 0 in 0.315s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:03 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 is being set with open permissions: ugo+rw Sep 30 10:28:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:03 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 Sep 30 10:28:03 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:03 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089" returned: 0 in 0.283s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.598s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:03 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0a814575-c173-49be-a96a-badd73e9c3e6 tempest-VolumesDeleteCascade-977645328 None] Create snapshot completed successfully Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Performing cascade delete. {{(pid=87013) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-750800cd-debd-42a0-bd54-86fdaf96b727-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-750800cd-debd-42a0-bd54-86fdaf96b727-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-750800cd-debd-42a0-bd54-86fdaf96b727" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-750800cd-debd-42a0-bd54-86fdaf96b727" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Deleting offline snapshot 750800cd-debd-42a0-bd54-86fdaf96b727 of volume fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] snapshot_file for this snap is: volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[84969b8b-f8ff-4179-b195-e759507739b7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:04 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 Sep 30 10:28:04 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Flow 'volume_create_manager' (ca98394e-b8a4-44d5-a6a3-14c272cdf748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:05 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ed1b36-b9ad-43c3-bf9b-ab589d8e27e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727" returned: 0 in 0.513s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ed1b36-b9ad-43c3-bf9b-ab589d8e27e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-349774487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1038012f-2fe5-49a6-a15a-32f9d7714136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e181eb705a1a4835a606ab93176eab56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:05Z,use_quota=True,user_id='7e329ec1d76944eebb0383ab6c59ca4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8aff0b5-6d87-4f2b-a8f0-57dbee229903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8aff0b5-6d87-4f2b-a8f0-57dbee229903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a298cef1-6839-4fd0-823e-e66ed9c6bbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a298cef1-6839-4fd0-823e-e66ed9c6bbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1038012f-2fe5-49a6-a15a-32f9d7714136', 'volume_name': 'volume-1038012f-2fe5-49a6-a15a-32f9d7714136', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1bb863-63ca-4d63-a495-056d4b765dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1bb863-63ca-4d63-a495-056d4b765dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876b49c5-9146-42c4-8faf-2e568510796f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:05 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Volume 1038012f-2fe5-49a6-a15a-32f9d7714136: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1038012f-2fe5-49a6-a15a-32f9d7714136', 'volume_size': 1} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-349774487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1038012f-2fe5-49a6-a15a-32f9d7714136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e181eb705a1a4835a606ab93176eab56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:05Z,use_quota=True,user_id='7e329ec1d76944eebb0383ab6c59ca4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Creating volume 1038012f-2fe5-49a6-a15a-32f9d7714136 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:28:05 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4a5279-d897-45a0-9b39-2cae3c327eb7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:05 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136 1073741824 Sep 30 10:28:05 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:05 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 Sep 30 10:28:05 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:05 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" returned: 0 in 0.549s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d75cab-cbf8-4fbb-9611-42adb3a34c4f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:05 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136 1073741824" returned: 0 in 0.706s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:06 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136 Sep 30 10:28:06 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:06 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 Sep 30 10:28:06 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:06 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136" returned: 0 in 0.264s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876b49c5-9146-42c4-8faf-2e568510796f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1038012f-2fe5-49a6-a15a-32f9d7714136', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b88f862-6987-42a5-b36f-b2ed90b2793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:06 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Volume volume-1038012f-2fe5-49a6-a15a-32f9d7714136 (1038012f-2fe5-49a6-a15a-32f9d7714136): created successfully Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b88f862-6987-42a5-b36f-b2ed90b2793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Flow 'volume_create_manager' (ca98394e-b8a4-44d5-a6a3-14c272cdf748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-803cb67e-9a5c-4fcc-a109-155b3a502d09 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Created volume successfully. Sep 30 10:28:06 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089" returned: 0 in 0.440s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f576fc0-451e-4572-8527-a38f3aea06ad]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:06 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 Sep 30 10:28:06 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:06 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727" returned: 0 in 0.390s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be72aa2-e86e-4356-95e7-62b806bc55c4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:06 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 Sep 30 10:28:06 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:07 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" returned: 0 in 0.404s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:07 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 Sep 30 10:28:07 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Acquiring lock "cinder-1038012f-2fe5-49a6-a15a-32f9d7714136-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "cinder-1038012f-2fe5-49a6-a15a-32f9d7714136-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Acquiring lock "cinder-quobyte-1038012f-2fe5-49a6-a15a-32f9d7714136" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "cinder-quobyte-1038012f-2fe5-49a6-a15a-32f9d7714136" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b18f13-8f2f-435a-8fd6-5b0abd4911c4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:07 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136 Sep 30 10:28:07 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:07 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727" returned: 0 in 0.370s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:07 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727 Sep 30 10:28:07 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:07 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136" returned: 0 in 0.419s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:07 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.750800cd-debd-42a0-bd54-86fdaf96b727" returned: 0 in 0.292s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 -F qcow2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:07 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136 Sep 30 10:28:07 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:07 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 -F qcow2 Sep 30 10:28:07 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:08 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1038012f-2fe5-49a6-a15a-32f9d7714136" returned: 0 in 0.257s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "cinder-quobyte-1038012f-2fe5-49a6-a15a-32f9d7714136" released by "delete_volume" :: held 0.720s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Created reservations ['3b450b5b-af27-4668-93a9-b164e4098374', '4b75b9cd-df1b-4c77-bfe7-8c9e01ba8397', 'ad7b161a-b76c-4289-b11f-168584742e64', 'ed0cc84a-1660-433a-b759-fa478fc67daf'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:08 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 -F qcow2" returned: 0 in 0.325s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-750800cd-debd-42a0-bd54-86fdaf96b727" released by "_delete_snapshot" :: held 3.626s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" released by "delete_snapshot" :: held 3.659s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:08 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:28:08 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Created reservations ['ad9c95fb-c779-4891-9d3c-d090e486ba7b', '29ba3b68-8002-44d5-bd85-36a93c0c7ff0', '69eb3449-faa9-427e-957f-c97cc2509a63', '55f474f7-f874-43ec-9a4c-20967cd12bbc'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:08 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Delete snapshot completed successfully. Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-750800cd-debd-42a0-bd54-86fdaf96b727-delete_snapshot" released by "delete_snapshot" :: held 3.860s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-79e9e144-0f65-445b-98a4-eed58e5a9089-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-79e9e144-0f65-445b-98a4-eed58e5a9089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-79e9e144-0f65-445b-98a4-eed58e5a9089" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-79e9e144-0f65-445b-98a4-eed58e5a9089" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Deleting offline snapshot 79e9e144-0f65-445b-98a4-eed58e5a9089 of volume fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] snapshot_file for this snap is: volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a0c6ea-8456-4fd8-8704-a69be664c6ee]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:08 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.259s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:28:08 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Deleted volume successfully. Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5db7900f-8825-4543-b3d8-d144a1439c11 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "cinder-1038012f-2fe5-49a6-a15a-32f9d7714136-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:08 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 Sep 30 10:28:08 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:08 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089" returned: 0 in 0.406s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bf7299-2449-4a31-8a66-df2006bfb43e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Flow 'volume_create_manager' (dff95151-c96a-4ae6-87ee-e779dd610c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27b9ece-2de8-499f-8ce1-f88a12b24d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:09 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 Sep 30 10:28:09 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27b9ece-2de8-499f-8ce1-f88a12b24d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-236184511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2dbea22-92ce-4699-8322-2e824d499439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e181eb705a1a4835a606ab93176eab56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:09Z,use_quota=True,user_id='7e329ec1d76944eebb0383ab6c59ca4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23aa8d88-a081-4964-a4c2-0be59140ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23aa8d88-a081-4964-a4c2-0be59140ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7144e5-bcd0-4bb5-b1e4-74ce959b7a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7144e5-bcd0-4bb5-b1e4-74ce959b7a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2dbea22-92ce-4699-8322-2e824d499439', 'volume_name': 'volume-f2dbea22-92ce-4699-8322-2e824d499439', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32cf9d3-16ae-42d6-8a7b-a77354fa15cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32cf9d3-16ae-42d6-8a7b-a77354fa15cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bec7fb-26c4-49f7-987b-cf5e1b4b16c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:09 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Volume f2dbea22-92ce-4699-8322-2e824d499439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2dbea22-92ce-4699-8322-2e824d499439', 'volume_size': 1} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-236184511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2dbea22-92ce-4699-8322-2e824d499439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e181eb705a1a4835a606ab93176eab56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:09Z,use_quota=True,user_id='7e329ec1d76944eebb0383ab6c59ca4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Creating volume f2dbea22-92ce-4699-8322-2e824d499439 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:28:09 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:09 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439 1073741824 Sep 30 10:28:09 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:09 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" returned: 0 in 0.367s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:09 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 Sep 30 10:28:09 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:09 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439 1073741824" returned: 0 in 0.453s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:09 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439 Sep 30 10:28:09 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:09 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089" returned: 0 in 0.381s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:09 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089 Sep 30 10:28:09 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:09 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439" returned: 0 in 0.280s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bec7fb-26c4-49f7-987b-cf5e1b4b16c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2dbea22-92ce-4699-8322-2e824d499439', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65af44b-eae9-4c6f-acf3-c60c530e95c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:09 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Volume volume-f2dbea22-92ce-4699-8322-2e824d499439 (f2dbea22-92ce-4699-8322-2e824d499439): created successfully Sep 30 10:28:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65af44b-eae9-4c6f-acf3-c60c530e95c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Flow 'volume_create_manager' (dff95151-c96a-4ae6-87ee-e779dd610c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:10 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8a202c4f-39de-4913-bf9b-b9f807fc9099 tempest-VolumeQuotasAdminTestJSON-1903523309 None] Created volume successfully. Sep 30 10:28:10 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532.79e9e144-0f65-445b-98a4-eed58e5a9089" returned: 0 in 0.299s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-79e9e144-0f65-445b-98a4-eed58e5a9089" released by "_delete_snapshot" :: held 1.577s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" released by "delete_snapshot" :: held 1.603s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Created reservations ['0c01ef16-f613-4c05-bdae-474208bb1e0c', '9586e89d-ece7-4e8d-8d19-b1cb5d3ffe64', '07630053-7238-42ed-8ed2-937733df1f94', 'd5d60262-1280-4148-935e-76a3114ebfb8'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:10 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Delete snapshot completed successfully. Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-79e9e144-0f65-445b-98a4-eed58e5a9089-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Snapshots deleted, issuing volume delete {{(pid=87013) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa6dca4-bec5-4b98-8090-c00f0c0fca39]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:10 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 Sep 30 10:28:10 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:10 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" returned: 0 in 0.402s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:10 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532 Sep 30 10:28:10 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Flow 'volume_create_manager' (fe7e49df-9ad6-4623-abff-2ebb20876d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8c8265-1e60-4727-9c01-6adc3b949f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8c8265-1e60-4727-9c01-6adc3b949f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-720383852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1638887-b4cc-4c34-b2ae-69baef091652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b92a5afafa47db957c0effe3ebd96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:11Z,use_quota=True,user_id='e0c774a286444489b6d1fbbab81adc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790014e0-78b3-4fe6-a575-69f035c8e90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790014e0-78b3-4fe6-a575-69f035c8e90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123538f2-15cf-4635-a789-84c5504146b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123538f2-15cf-4635-a789-84c5504146b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1638887-b4cc-4c34-b2ae-69baef091652', 'volume_name': 'volume-a1638887-b4cc-4c34-b2ae-69baef091652', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22e51eb-0bd2-4360-b6b3-fe4e3cf23f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22e51eb-0bd2-4360-b6b3-fe4e3cf23f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c1967a-ef7a-49aa-9360-6837ff25962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:10 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Volume a1638887-b4cc-4c34-b2ae-69baef091652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1638887-b4cc-4c34-b2ae-69baef091652', 'volume_size': 1} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-720383852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1638887-b4cc-4c34-b2ae-69baef091652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b92a5afafa47db957c0effe3ebd96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:11Z,use_quota=True,user_id='e0c774a286444489b6d1fbbab81adc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Creating volume a1638887-b4cc-4c34-b2ae-69baef091652 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:28:10 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:10 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652 1073741824 Sep 30 10:28:10 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:10 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" returned: 0 in 0.296s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532" released by "delete_volume" :: held 0.770s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Created reservations ['8be0ed0b-a811-4857-990a-a1b07667c0be', '194dcd5f-08c7-423b-8b89-03c04e511bc1', '5ab5a439-7722-4289-b352-0631ae0c568d', '2ae5e8f1-25ed-4dac-ba10-c71cca9d690c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:11 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:28:11 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:11 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652 1073741824" returned: 0 in 0.670s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:11 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.425s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:28:11 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652 Sep 30 10:28:11 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:11 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Deleted volume successfully. Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91270ff9-f6b5-4a48-9366-1946e5d47e5a tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-fc2bfcc0-75e2-49d2-b00d-5a5c825c2532-delete_volume" released by "delete_volume" :: held 7.252s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:11 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652" returned: 0 in 0.335s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:28:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c1967a-ef7a-49aa-9360-6837ff25962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1638887-b4cc-4c34-b2ae-69baef091652', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15fbdeb-f7b1-4423-b3a6-751cf7d46d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:12 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Volume volume-a1638887-b4cc-4c34-b2ae-69baef091652 (a1638887-b4cc-4c34-b2ae-69baef091652): created successfully Sep 30 10:28:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15fbdeb-f7b1-4423-b3a6-751cf7d46d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Flow 'volume_create_manager' (fe7e49df-9ad6-4623-abff-2ebb20876d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a24e58fe-45f1-4f40-ac68-572251d236a0 tempest-ServerActionsTestOtherA-342232922 None] Created volume successfully. Sep 30 10:28:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-aad91f2e-2cee-4c7d-9a77-2786b789fc88 tempest-VolumeQuotasAdminTestJSON-1514571680 None] Transfer volume completed successfully. Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Acquiring lock "cinder-f2dbea22-92ce-4699-8322-2e824d499439-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Lock "cinder-f2dbea22-92ce-4699-8322-2e824d499439-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Acquiring lock "cinder-quobyte-f2dbea22-92ce-4699-8322-2e824d499439" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Lock "cinder-quobyte-f2dbea22-92ce-4699-8322-2e824d499439" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbaaf9f-d596-48b2-8dd4-b60d458eb8e7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Flow 'volume_create_manager' (0ddc5e86-9b18-457a-9628-8531e88cd614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe0296a-3e9c-4de1-8fde-5c999c7c3cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe0296a-3e9c-4de1-8fde-5c999c7c3cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-784150154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4195272-611e-4c49-bce0-ac91cacb60bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636f3f8faf5640658656cf0a1417e8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:13Z,use_quota=True,user_id='e3540908f2234285aeb93658d43ae3bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec418b7-4d9f-4362-8090-b8ceff73df52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec418b7-4d9f-4362-8090-b8ceff73df52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a640e93-97b3-40f0-825d-757530ab81e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a640e93-97b3-40f0-825d-757530ab81e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4195272-611e-4c49-bce0-ac91cacb60bb', 'volume_name': 'volume-f4195272-611e-4c49-bce0-ac91cacb60bb', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ffc9d0-eeff-4c48-ae1f-426972f80c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ffc9d0-eeff-4c48-ae1f-426972f80c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903ab03b-3614-435e-a349-f2a721b2e5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:13 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Volume f4195272-611e-4c49-bce0-ac91cacb60bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4195272-611e-4c49-bce0-ac91cacb60bb', 'volume_size': 1} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-784150154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4195272-611e-4c49-bce0-ac91cacb60bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636f3f8faf5640658656cf0a1417e8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:13Z,use_quota=True,user_id='e3540908f2234285aeb93658d43ae3bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Creating volume f4195272-611e-4c49-bce0-ac91cacb60bb {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:28:13 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:13 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439 Sep 30 10:28:13 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:13 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb 1073741824 Sep 30 10:28:13 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:13 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439" returned: 0 in 0.499s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:13 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439 Sep 30 10:28:13 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:13 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb 1073741824" returned: 0 in 0.549s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:13 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb Sep 30 10:28:13 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:13 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f2dbea22-92ce-4699-8322-2e824d499439" returned: 0 in 0.318s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Lock "cinder-quobyte-f2dbea22-92ce-4699-8322-2e824d499439" released by "delete_volume" :: held 0.882s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Created reservations ['fb1aa3de-da01-4305-8d37-8bb43fee6420', '248c3861-88e4-4c9a-9600-ffa22728a1dd', 'e9a300d9-0b3b-4805-8b3a-a5187d399abc', 'ab234819-cd1a-4f85-a41c-0f1df8a865e9'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:14 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb" returned: 0 in 0.297s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:14 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:28:14 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903ab03b-3614-435e-a349-f2a721b2e5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4195272-611e-4c49-bce0-ac91cacb60bb', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824e5617-81f9-465e-b01d-9c541278bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:14 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Volume volume-f4195272-611e-4c49-bce0-ac91cacb60bb (f4195272-611e-4c49-bce0-ac91cacb60bb): created successfully Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824e5617-81f9-465e-b01d-9c541278bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Flow 'volume_create_manager' (0ddc5e86-9b18-457a-9628-8531e88cd614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:14 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d1828e3a-b04f-4bdd-b5fb-8eddc653e052 tempest-VolumesDeleteCascade-977645328 None] Created volume successfully. Sep 30 10:28:14 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.273s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:28:14 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Deleted volume successfully. Sep 30 10:28:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f26cec7-1331-4ba6-b0ad-d966df29d4fd tempest-VolumeQuotasAdminTestJSON-948223755 None] Lock "cinder-f2dbea22-92ce-4699-8322-2e824d499439-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Flow 'volume_create_manager' (2eff370c-f5da-463e-95c6-771056f26659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b27293-a985-4fec-b8ec-740bfa69daf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Creating offline snapshot 06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 of volume f4195272-611e-4c49-bce0-ac91cacb60bb {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b27293-a985-4fec-b8ec-740bfa69daf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-666847297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e897334f-84a2-4473-8f19-c126eced432f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a18464bd6094392984c61f5b8812621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:16Z,use_quota=True,user_id='af30d8e8377e4b34b35b093e599a542f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2086e0b5-2f89-4d52-8bbf-23545d2f71f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2086e0b5-2f89-4d52-8bbf-23545d2f71f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2221f1ff-7cd8-449d-9b67-ef236709ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2221f1ff-7cd8-449d-9b67-ef236709ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e897334f-84a2-4473-8f19-c126eced432f', 'volume_name': 'volume-e897334f-84a2-4473-8f19-c126eced432f', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0171d0-0170-4774-baff-bda8889283a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0171d0-0170-4774-baff-bda8889283a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5338826c-d5f1-4147-8a13-823388f0a2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:15 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Volume e897334f-84a2-4473-8f19-c126eced432f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e897334f-84a2-4473-8f19-c126eced432f', 'volume_size': 1} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb518ef5-7cef-432b-b516-15b69f5d4584]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:15 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb Sep 30 10:28:15 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:16 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb" returned: 0 in 0.463s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:16 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 1G Sep 30 10:28:16 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:16 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 1G" returned: 0 in 0.650s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4195272-611e-4c49-bce0-ac91cacb60bb -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:16 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4195272-611e-4c49-bce0-ac91cacb60bb -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 Sep 30 10:28:16 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:17 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4195272-611e-4c49-bce0-ac91cacb60bb -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6" returned: 0 in 0.474s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:17 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 is being set with open permissions: ugo+rw Sep 30 10:28:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:17 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 Sep 30 10:28:17 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:17 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6" returned: 0 in 0.322s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:17 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.info Sep 30 10:28:17 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:18 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.info" returned: 0 in 0.297s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:18 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.info is being set with open permissions: ugo+rw Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:18 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.info Sep 30 10:28:18 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:18 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.info" returned: 0 in 0.294s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.584s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-666847297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e897334f-84a2-4473-8f19-c126eced432f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a18464bd6094392984c61f5b8812621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:16Z,use_quota=True,user_id='af30d8e8377e4b34b35b093e599a542f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Creating volume e897334f-84a2-4473-8f19-c126eced432f {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:28:18 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:28:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:18 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f 1073741824 Sep 30 10:28:18 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:18 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7fd7e575-3548-425e-93d7-dd06778ac7cb tempest-VolumesDeleteCascade-977645328 None] Create snapshot completed successfully Sep 30 10:28:19 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f 1073741824" returned: 0 in 0.674s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:19 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f Sep 30 10:28:19 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:19 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f" returned: 0 in 0.557s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5338826c-d5f1-4147-8a13-823388f0a2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e897334f-84a2-4473-8f19-c126eced432f', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842bda89-1159-4257-9df0-27fe5642d3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:19 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Volume volume-e897334f-84a2-4473-8f19-c126eced432f (e897334f-84a2-4473-8f19-c126eced432f): created successfully Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842bda89-1159-4257-9df0-27fe5642d3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Flow 'volume_create_manager' (2eff370c-f5da-463e-95c6-771056f26659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:19 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7604efac-f5ee-4fa9-b7f9-8727c970a38f tempest-AttachVolumeNegativeTest-1648356732 None] Created volume successfully. Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Flow 'volume_create_manager' (a47a13dc-8698-4066-8d54-91486f252976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a06fb9-8267-414a-b3a2-4a3befdb7bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a06fb9-8267-414a-b3a2-4a3befdb7bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-410342986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7505b1e8-2d52-4ffc-b8e5-73575f26ab77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636f3f8faf5640658656cf0a1417e8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06c61d58-e16f-4d5c-9b33-1d58a02f2ef6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:20Z,use_quota=True,user_id='e3540908f2234285aeb93658d43ae3bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99706b7-8084-4243-9984-128664a4af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99706b7-8084-4243-9984-128664a4af4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db37508-d72a-45cc-a431-0f3c7ffda15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db37508-d72a-45cc-a431-0f3c7ffda15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7505b1e8-2d52-4ffc-b8e5-73575f26ab77', 'volume_name': 'volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77', 'volume_size': 1, 'snapshot_id': '06c61d58-e16f-4d5c-9b33-1d58a02f2ef6'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7b4952-ecc0-4d10-9467-7bd6522fe2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7b4952-ecc0-4d10-9467-7bd6522fe2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0029c717-9c42-4b29-a03d-0c80a20f9690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:20 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Volume 7505b1e8-2d52-4ffc-b8e5-73575f26ab77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77', 'volume_size': 1, 'snapshot_id': '06c61d58-e16f-4d5c-9b33-1d58a02f2ef6'} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-06c61d58-e16f-4d5c-9b33-1d58a02f2ef6-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" by "_create_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-06c61d58-e16f-4d5c-9b33-1d58a02f2ef6-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Creating volume 7505b1e8-2d52-4ffc-b8e5-73575f26ab77 from snapshot 06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 {{(pid=87013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] snapshot: 06c61d58-e16f-4d5c-9b33-1d58a02f2ef6, volume: 7505b1e8-2d52-4ffc-b8e5-73575f26ab77, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd9c509-5a6b-4a07-8ea9-6d157341e58a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:20 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 Sep 30 10:28:20 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:20 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6" returned: 0 in 0.624s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4195272-611e-4c49-bce0-ac91cacb60bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78dcb1e-565a-4085-adce-3863e66a658b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:21 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb Sep 30 10:28:21 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-0e971874-6160-466e-be48-d6d5f25b7559 req-cf12459f-18a6-43fe-a098-3f539366586a tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:21 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb" returned: 0 in 0.582s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:28:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:28:21 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:28:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:21 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 Sep 30 10:28:21 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Flow 'volume_create_manager' (073c9ce3-5c2d-40ea-abe5-afbf386ba21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b498a9-f9a7-4e8f-9673-0b796f8f0156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b498a9-f9a7-4e8f-9673-0b796f8f0156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-438462433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f3ad53-0e93-46d6-9d07-2f8687aa922d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d696157e0e5478ebe7da48169d3e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:28Z,use_quota=True,user_id='8c25b057aee84661bde4dcb93f5da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976e5c6f-cd08-4f95-94bb-5283916b07bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976e5c6f-cd08-4f95-94bb-5283916b07bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a700046d-f575-439a-bf67-fe48be77abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a700046d-f575-439a-bf67-fe48be77abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f3ad53-0e93-46d6-9d07-2f8687aa922d', 'volume_name': 'volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9699ec0-07bc-40f7-ac99-887f657203d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9699ec0-07bc-40f7-ac99-887f657203d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef5b8aa-ce7f-40af-91b2-f55d5e4e8dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:28 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Volume 45f3ad53-0e93-46d6-9d07-2f8687aa922d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d', 'volume_size': 1} Sep 30 10:28:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:31 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" returned: 0 in 9.741s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb, size 1024.00 MB, duration 9.74 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:28:31 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Converted 1024.00 MB image at 105.11 MB/s Sep 30 10:28:31 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 is being set with open permissions: ugo+rw Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:31 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 Sep 30 10:28:31 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:31 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" returned: 0 in 0.238s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" released by "_copy_volume_from_snapshot" :: held 11.356s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-06c61d58-e16f-4d5c-9b33-1d58a02f2ef6-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" released by "_create_volume_from_snapshot" :: held 11.441s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.464s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-0e971874-6160-466e-be48-d6d5f25b7559 req-cf12459f-18a6-43fe-a098-3f539366586a tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.240s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-0e971874-6160-466e-be48-d6d5f25b7559 req-cf12459f-18a6-43fe-a098-3f539366586a tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-438462433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f3ad53-0e93-46d6-9d07-2f8687aa922d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d696157e0e5478ebe7da48169d3e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:28Z,use_quota=True,user_id='8c25b057aee84661bde4dcb93f5da851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Creating volume 45f3ad53-0e93-46d6-9d07-2f8687aa922d {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:28:31 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0029c717-9c42-4b29-a03d-0c80a20f9690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77', 'volume_size': 1, 'snapshot_id': '06c61d58-e16f-4d5c-9b33-1d58a02f2ef6'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:31 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d 1073741824 Sep 30 10:28:31 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d713725-8f8e-4739-8b04-697ae2a17968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Volume volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 (7505b1e8-2d52-4ffc-b8e5-73575f26ab77): created successfully Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d713725-8f8e-4739-8b04-697ae2a17968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Flow 'volume_create_manager' (a47a13dc-8698-4066-8d54-91486f252976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-0e971874-6160-466e-be48-d6d5f25b7559 req-cf12459f-18a6-43fe-a098-3f539366586a tempest-AttachVolumeNegativeTest-1648356732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-e897334f-84a2-4473-8f19-c126eced432f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60105a01-3a61-4e42-b7f5-a7d8092f875c', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:28:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-00bdcdc2-e36b-48cf-bfff-0fd8eed205f0 tempest-VolumesDeleteCascade-977645328 None] Created volume successfully. Sep 30 10:28:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-0e971874-6160-466e-be48-d6d5f25b7559 req-cf12459f-18a6-43fe-a098-3f539366586a tempest-AttachVolumeNegativeTest-1648356732 None] attachment_update completed successfully. Sep 30 10:28:32 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d 1073741824" returned: 0 in 0.520s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:32 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d Sep 30 10:28:32 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:32 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d" returned: 0 in 0.262s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef5b8aa-ce7f-40af-91b2-f55d5e4e8dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4236e0f2-8620-41c2-8dd0-b88df218002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Volume volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d (45f3ad53-0e93-46d6-9d07-2f8687aa922d): created successfully Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4236e0f2-8620-41c2-8dd0-b88df218002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Flow 'volume_create_manager' (073c9ce3-5c2d-40ea-abe5-afbf386ba21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-801b6f09-3c9f-4337-9de9-377861de6d08 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Created volume successfully. Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-f4195272-611e-4c49-bce0-ac91cacb60bb-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-f4195272-611e-4c49-bce0-ac91cacb60bb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Performing cascade delete. {{(pid=87013) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-06c61d58-e16f-4d5c-9b33-1d58a02f2ef6-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-06c61d58-e16f-4d5c-9b33-1d58a02f2ef6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-f4195272-611e-4c49-bce0-ac91cacb60bb" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-f4195272-611e-4c49-bce0-ac91cacb60bb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-06c61d58-e16f-4d5c-9b33-1d58a02f2ef6" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-06c61d58-e16f-4d5c-9b33-1d58a02f2ef6" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Deleting offline snapshot 06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 of volume f4195272-611e-4c49-bce0-ac91cacb60bb {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:28:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] snapshot_file for this snap is: volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e778b9a-c3ba-4fd7-a589-613d59019556]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Creating offline snapshot 97bef3cd-4b59-4102-a209-43de2403bd17 of volume 45f3ad53-0e93-46d6-9d07-2f8687aa922d {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a4be2c-9d1d-4395-a5ae-6b82868c6c5d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:33 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 Sep 30 10:28:33 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:33 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d Sep 30 10:28:33 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:33 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6" returned: 0 in 0.390s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4195272-611e-4c49-bce0-ac91cacb60bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cd2410-3b47-4cd1-ae81-3df9779c094d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:33 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d" returned: 0 in 0.422s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:33 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb Sep 30 10:28:33 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 1G Sep 30 10:28:33 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:33 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:33 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 1G" returned: 0 in 0.467s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:34 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb" returned: 0 in 0.580s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:34 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 Sep 30 10:28:34 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:34 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 Sep 30 10:28:34 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:34 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17" returned: 0 in 0.414s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:34 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 is being set with open permissions: ugo+rw Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:34 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 Sep 30 10:28:34 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:34 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6" returned: 0 in 0.439s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:34 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6 Sep 30 10:28:34 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:34 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17" returned: 0 in 0.349s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:34 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=83,cinder:UPDATE=68,cinder:DELETE=11,cinder:INSERT=25 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=76,cinder:UPDATE=99,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb.06c61d58-e16f-4d5c-9b33-1d58a02f2ef6" returned: 0 in 0.330s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-06c61d58-e16f-4d5c-9b33-1d58a02f2ef6" released by "_delete_snapshot" :: held 1.916s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-f4195272-611e-4c49-bce0-ac91cacb60bb" released by "delete_snapshot" :: held 1.982s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:34 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.info Sep 30 10:28:34 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Created reservations ['a7d0376d-36a5-4ca7-bd61-93ac88209d8a', '566cb905-cd31-49cd-96f5-c903d2e4e6f1', 'cd5b3ef6-b5b7-4e4f-be38-0c22fa07736f', '514a6f4c-dafc-4921-9079-d3000785f786'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Delete snapshot completed successfully. Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-06c61d58-e16f-4d5c-9b33-1d58a02f2ef6-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Snapshots deleted, issuing volume delete {{(pid=87013) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-f4195272-611e-4c49-bce0-ac91cacb60bb" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-f4195272-611e-4c49-bce0-ac91cacb60bb" acquired by "delete_volume" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e58df8-93b5-4f19-b2b6-46f11512a506]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:35 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.info" returned: 0 in 0.499s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:35 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.info is being set with open permissions: ugo+rw Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:35 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb Sep 30 10:28:35 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:35 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.info Sep 30 10:28:35 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:35 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb" returned: 0 in 0.432s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:35 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.info" returned: 0 in 0.337s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:35 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb Sep 30 10:28:35 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.725s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-5b100b74-d154-4ae7-9255-f37c0dc4251a tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Create snapshot completed successfully Sep 30 10:28:35 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4195272-611e-4c49-bce0-ac91cacb60bb" returned: 0 in 0.276s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-f4195272-611e-4c49-bce0-ac91cacb60bb" released by "delete_volume" :: held 0.810s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Created reservations ['1d0a5494-0391-47b5-972c-7ab23f87eda5', '7ef946c5-cb9f-4610-b8ad-2fbcc6240b69', 'cd4d5afb-2d8d-4a07-896d-b0aa83d6bf82', '6784507f-b562-43ee-b744-947f8c54e3cc'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:36 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:28:36 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:36 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.277s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:28:36 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Deleted volume successfully. Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2739a0f1-87f7-4e97-a999-9b919ae6830b tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-f4195272-611e-4c49-bce0-ac91cacb60bb-delete_volume" released by "delete_volume" :: held 3.751s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Acquiring lock "cinder-97bef3cd-4b59-4102-a209-43de2403bd17-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "cinder-97bef3cd-4b59-4102-a209-43de2403bd17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Acquiring lock "cinder-quobyte-45f3ad53-0e93-46d6-9d07-2f8687aa922d" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "cinder-quobyte-45f3ad53-0e93-46d6-9d07-2f8687aa922d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Acquiring lock "cinder-quobyte-97bef3cd-4b59-4102-a209-43de2403bd17" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "cinder-quobyte-97bef3cd-4b59-4102-a209-43de2403bd17" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Deleting offline snapshot 97bef3cd-4b59-4102-a209-43de2403bd17 of volume 45f3ad53-0e93-46d6-9d07-2f8687aa922d {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] snapshot_file for this snap is: volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f059f5-314e-4586-9ab5-a145bd70c47c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:36 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 Sep 30 10:28:36 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:37 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:28:37 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:37 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17" returned: 0 in 0.398s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba0789-9e0a-4064-908f-a8587ba630a0]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:37 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.296s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 28 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:28:37 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d Sep 30 10:28:37 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-7505b1e8-2d52-4ffc-b8e5-73575f26ab77-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-7505b1e8-2d52-4ffc-b8e5-73575f26ab77-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "cinder-quobyte-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2b8d40-7b27-45bb-abdc-82c89c2b9689]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:37 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 Sep 30 10:28:37 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:37 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d" returned: 0 in 0.517s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:37 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 Sep 30 10:28:37 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:37 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" returned: 0 in 0.421s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:37 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77 Sep 30 10:28:37 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:38 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17" returned: 0 in 0.407s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:38 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17 Sep 30 10:28:38 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:38 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" returned: 0 in 0.273s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-quobyte-7505b1e8-2d52-4ffc-b8e5-73575f26ab77" released by "delete_volume" :: held 0.744s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Created reservations ['c8aefbb4-2d0a-4c68-9523-05561dd2d50d', '99eccce3-ab4d-4025-8f96-1775304162e3', '60c25288-808d-42a1-8269-3fafd75f14f4', '6e28f77e-86d6-4f6f-8245-8a141d49da69'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:38 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:28:38 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:38 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d.97bef3cd-4b59-4102-a209-43de2403bd17" returned: 0 in 0.290s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "cinder-quobyte-97bef3cd-4b59-4102-a209-43de2403bd17" released by "_delete_snapshot" :: held 1.778s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "cinder-quobyte-45f3ad53-0e93-46d6-9d07-2f8687aa922d" released by "delete_snapshot" :: held 1.805s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Created reservations ['478b870b-602a-46b4-86c6-203af096051d', '0e7e43c1-a151-44ef-8491-d21d32bf2b02', 'c3635d40-c9f6-4f2e-877f-359fe1b16f3f', 'bb13cda1-e0f6-451f-89f5-399390d97b2b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Delete snapshot completed successfully. Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7193cc79-d13b-47b4-985a-f074ebf5bd68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "cinder-97bef3cd-4b59-4102-a209-43de2403bd17-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:38 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.348s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:28:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Deleted volume successfully. Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0764cd7a-8a5d-40a7-8dc0-f7392a0f2318 tempest-VolumesDeleteCascade-977645328 None] Lock "cinder-7505b1e8-2d52-4ffc-b8e5-73575f26ab77-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Acquiring lock "cinder-45f3ad53-0e93-46d6-9d07-2f8687aa922d-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "cinder-45f3ad53-0e93-46d6-9d07-2f8687aa922d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Acquiring lock "cinder-quobyte-45f3ad53-0e93-46d6-9d07-2f8687aa922d" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "cinder-quobyte-45f3ad53-0e93-46d6-9d07-2f8687aa922d" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:39 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[45be9afa-dd94-4b44-b483-3e5c823fdd77]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:39 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d Sep 30 10:28:39 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:39 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d" returned: 0 in 0.443s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:39 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d Sep 30 10:28:39 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:39 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-45f3ad53-0e93-46d6-9d07-2f8687aa922d" returned: 0 in 0.287s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "cinder-quobyte-45f3ad53-0e93-46d6-9d07-2f8687aa922d" released by "delete_volume" :: held 0.822s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:39 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Created reservations ['7b3196d2-9468-48c9-a9d3-f87ed0ef0c9d', '26160741-d370-4a6d-a1ab-c5678394e41b', '40d39ea2-8305-45f8-a266-bbd30641672c', 'f6b3775d-c614-4d0a-b22c-4d997d3761d5'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:40 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:28:40 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:40 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.406s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:40 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:28:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Deleted volume successfully. Sep 30 10:28:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-41362c82-607c-4cbc-9e03-3622f56179af tempest-VolumeSnapshotQuotasNegativeTestJSON-1345652238 None] Lock "cinder-45f3ad53-0e93-46d6-9d07-2f8687aa922d-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Flow 'volume_create_manager' (eaf5ed80-0549-4c13-92b9-635e600f423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c581a4b8-1ab0-4402-99c9-865ed9f4fb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c581a4b8-1ab0-4402-99c9-865ed9f4fb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2017064214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f58d4b-5b40-42a0-9c5b-2656efa11e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac7dd600dee40c2b1a4a02f3acdf5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:46Z,use_quota=True,user_id='e0a17dd271af4aa1895f9bca2df477f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc79fec-2cad-4ff9-a9aa-e2e76ed324d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc79fec-2cad-4ff9-a9aa-e2e76ed324d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fae4b3-7116-45d0-9595-c05a2a7b1458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fae4b3-7116-45d0-9595-c05a2a7b1458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f58d4b-5b40-42a0-9c5b-2656efa11e63', 'volume_name': 'volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9315e02f-d679-4cac-80de-08a08c2871d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9315e02f-d679-4cac-80de-08a08c2871d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26401d0f-6205-4b00-b88d-7ce007864fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:46 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Volume 94f58d4b-5b40-42a0-9c5b-2656efa11e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63', 'volume_size': 1} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2017064214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f58d4b-5b40-42a0-9c5b-2656efa11e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac7dd600dee40c2b1a4a02f3acdf5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:46Z,use_quota=True,user_id='e0a17dd271af4aa1895f9bca2df477f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Creating volume 94f58d4b-5b40-42a0-9c5b-2656efa11e63 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:28:46 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:28:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:46 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63 1073741824 Sep 30 10:28:46 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:47 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63 1073741824" returned: 0 in 0.766s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:47 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63 Sep 30 10:28:47 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:47 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63" returned: 0 in 0.420s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:28:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26401d0f-6205-4b00-b88d-7ce007864fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c219bac8-8fd4-4e45-8459-5e74fd996f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:47 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Volume volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63 (94f58d4b-5b40-42a0-9c5b-2656efa11e63): created successfully Sep 30 10:28:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c219bac8-8fd4-4e45-8459-5e74fd996f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Flow 'volume_create_manager' (eaf5ed80-0549-4c13-92b9-635e600f423d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:47 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9468915b-e876-4d25-b17f-6f903249506a tempest-VolumesTransfersV355Test-1270552424 None] Created volume successfully. Sep 30 10:28:49 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f14851e3-a665-488b-8790-2edb7630c13d tempest-VolumesTransfersV355Test-272020201 None] Transfer volume completed successfully. Sep 30 10:28:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-ae9c6dcb-1f8b-451e-8c54-0f8bfe4a4355 req-1b9fc1f0-9e29-45d9-9838-4af39f82c25d tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-ae9c6dcb-1f8b-451e-8c54-0f8bfe4a4355 req-1b9fc1f0-9e29-45d9-9838-4af39f82c25d tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-ae9c6dcb-1f8b-451e-8c54-0f8bfe4a4355 req-1b9fc1f0-9e29-45d9-9838-4af39f82c25d tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-ae9c6dcb-1f8b-451e-8c54-0f8bfe4a4355 req-1b9fc1f0-9e29-45d9-9838-4af39f82c25d tempest-ServerActionsTestOtherA-342232922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-a1638887-b4cc-4c34-b2ae-69baef091652', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '748cd1eb-a2cf-42a7-8e27-3566c15e4676', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:28:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Acquiring lock "cinder-94f58d4b-5b40-42a0-9c5b-2656efa11e63-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Lock "cinder-94f58d4b-5b40-42a0-9c5b-2656efa11e63-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:50 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-ae9c6dcb-1f8b-451e-8c54-0f8bfe4a4355 req-1b9fc1f0-9e29-45d9-9838-4af39f82c25d tempest-ServerActionsTestOtherA-342232922 None] attachment_update completed successfully. Sep 30 10:28:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Acquiring lock "cinder-quobyte-94f58d4b-5b40-42a0-9c5b-2656efa11e63" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Lock "cinder-quobyte-94f58d4b-5b40-42a0-9c5b-2656efa11e63" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:50 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[94817213-cf78-4198-a375-18487a4ba59a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:50 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63 Sep 30 10:28:50 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:51 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63" returned: 0 in 0.565s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:51 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63 Sep 30 10:28:51 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:51 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94f58d4b-5b40-42a0-9c5b-2656efa11e63" returned: 0 in 0.407s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Lock "cinder-quobyte-94f58d4b-5b40-42a0-9c5b-2656efa11e63" released by "delete_volume" :: held 1.067s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:51 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Created reservations ['5c46b4d1-18fd-4de6-a721-9c2433a05a66', '1ce759ab-9568-4141-a2c5-b6d86946a864', 'bdb697b1-87e4-4dd2-a530-5d660bf98bc6', '4fe87324-7c31-439d-9a01-eaab257e69ae'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:52 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:28:52 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:52 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.272s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:52 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:28:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Deleted volume successfully. Sep 30 10:28:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30b23331-dd10-460a-a38a-a769ad34fb4e tempest-VolumesTransfersV355Test-569303890 None] Lock "cinder-94f58d4b-5b40-42a0-9c5b-2656efa11e63-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:53 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:28:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Flow 'volume_create_manager' (10e5b4cf-ce6c-4eed-b541-db41ae24e91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1461436c-eb0f-4c72-a114-44a20529c135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1461436c-eb0f-4c72-a114-44a20529c135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-637649832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87210cf3-c033-47af-a126-c47579352df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac7dd600dee40c2b1a4a02f3acdf5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:54Z,use_quota=True,user_id='e0a17dd271af4aa1895f9bca2df477f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dc8608-7c79-499a-a295-2d4e990b2c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dc8608-7c79-499a-a295-2d4e990b2c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafc94bb-4ae2-4462-8a26-338a683f4a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafc94bb-4ae2-4462-8a26-338a683f4a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87210cf3-c033-47af-a126-c47579352df5', 'volume_name': 'volume-87210cf3-c033-47af-a126-c47579352df5', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c58184-4482-4941-8359-a0d638b4da8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:53 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c58184-4482-4941-8359-a0d638b4da8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3e8745-650d-408b-a4fe-99f5882b017e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:54 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Volume 87210cf3-c033-47af-a126-c47579352df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87210cf3-c033-47af-a126-c47579352df5', 'volume_size': 1} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-637649832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87210cf3-c033-47af-a126-c47579352df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac7dd600dee40c2b1a4a02f3acdf5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:28:54Z,use_quota=True,user_id='e0a17dd271af4aa1895f9bca2df477f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Creating volume 87210cf3-c033-47af-a126-c47579352df5 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:28:54 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:54 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5 1073741824 Sep 30 10:28:54 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:54 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5 1073741824" returned: 0 in 0.738s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:54 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5 Sep 30 10:28:54 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:55 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5" returned: 0 in 0.352s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:28:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3e8745-650d-408b-a4fe-99f5882b017e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87210cf3-c033-47af-a126-c47579352df5', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8319507e-b258-41d1-84e8-21760992d940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:55 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Volume volume-87210cf3-c033-47af-a126-c47579352df5 (87210cf3-c033-47af-a126-c47579352df5): created successfully Sep 30 10:28:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8319507e-b258-41d1-84e8-21760992d940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Flow 'volume_create_manager' (10e5b4cf-ce6c-4eed-b541-db41ae24e91e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-033fe9ff-f369-4ba6-bbd6-5542d5d5d1f8 req-b2326d82-0ccc-4eba-815d-c8eb2ca61599 tempest-ServerActionsTestOtherA-342232922 None] Terminate volume connection completed successfully. Sep 30 10:28:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-033fe9ff-f369-4ba6-bbd6-5542d5d5d1f8 req-b2326d82-0ccc-4eba-815d-c8eb2ca61599 tempest-ServerActionsTestOtherA-342232922 None] Deleting attachment 748cd1eb-a2cf-42a7-8e27-3566c15e4676. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:28:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-26eac1c2-1302-447b-8f1a-f2f64c8e3536 tempest-VolumesTransfersV355Test-1270552424 None] Created volume successfully. Sep 30 10:28:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Acquiring lock "cinder-87210cf3-c033-47af-a126-c47579352df5-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-033fe9ff-f369-4ba6-bbd6-5542d5d5d1f8 req-3a64d4eb-f574-455c-a00f-af12f4000d55 tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-033fe9ff-f369-4ba6-bbd6-5542d5d5d1f8 req-3a64d4eb-f574-455c-a00f-af12f4000d55 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Lock "cinder-87210cf3-c033-47af-a126-c47579352df5-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-033fe9ff-f369-4ba6-bbd6-5542d5d5d1f8 req-3a64d4eb-f574-455c-a00f-af12f4000d55 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.064s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-033fe9ff-f369-4ba6-bbd6-5542d5d5d1f8 req-3a64d4eb-f574-455c-a00f-af12f4000d55 tempest-ServerActionsTestOtherA-342232922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-a1638887-b4cc-4c34-b2ae-69baef091652', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53f2e50f-a0a6-4606-8a68-02123a02aeaa', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:28:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Acquiring lock "cinder-quobyte-87210cf3-c033-47af-a126-c47579352df5" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:28:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Lock "cinder-quobyte-87210cf3-c033-47af-a126-c47579352df5" acquired by "delete_volume" :: waited 0.032s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:28:56 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[268a11b8-6b1b-454a-8da8-badcfec4f06a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:28:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-033fe9ff-f369-4ba6-bbd6-5542d5d5d1f8 req-3a64d4eb-f574-455c-a00f-af12f4000d55 tempest-ServerActionsTestOtherA-342232922 None] attachment_update completed successfully. Sep 30 10:28:56 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5 Sep 30 10:28:56 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:57 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5" returned: 0 in 0.665s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:57 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5 Sep 30 10:28:57 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:57 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-87210cf3-c033-47af-a126-c47579352df5" returned: 0 in 0.350s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Lock "cinder-quobyte-87210cf3-c033-47af-a126-c47579352df5" released by "delete_volume" :: held 1.078s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:57 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Created reservations ['9483461d-29f2-422e-97df-11e5129220f5', '57044b97-4e55-42f9-89e7-d684aaaec3d0', '22a64ef9-defa-487e-92b7-ab88642351c4', '11f872a7-440e-4512-bae1-aa9a65b94fdd'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:28:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:28:58 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:28:58 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:28:58 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Sep 30 10:28:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.376s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:28:58 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:28:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Deleted volume successfully. Sep 30 10:28:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4be1d968-d9b0-46b6-87d4-eb63eea5a3ae tempest-VolumesTransfersV355Test-569303890 None] Lock "cinder-87210cf3-c033-47af-a126-c47579352df5-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Flow 'volume_create_manager' (57113d5d-c9f6-4271-9848-6d079fadcf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df6ae0c-a582-4a3d-a7f8-1a753cbbf0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df6ae0c-a582-4a3d-a7f8-1a753cbbf0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-129814632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85b0776-dbb6-4652-a6d6-c8881c1249d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566402968a1f4bce9c3e2c35626f9807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:00Z,use_quota=True,user_id='a77dcdcd9a1f4f5b85e89a5b2b06393b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58594c2-2280-446f-8ead-396c582f4094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58594c2-2280-446f-8ead-396c582f4094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf0d781-47bb-4068-8e5d-c545b2d4d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf0d781-47bb-4068-8e5d-c545b2d4d212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85b0776-dbb6-4652-a6d6-c8881c1249d2', 'volume_name': 'volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5ab8fd-ed84-441e-9d7e-f86df54c3cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5ab8fd-ed84-441e-9d7e-f86df54c3cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a752804-66ea-47d2-bd1d-e660d4b627dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:28:59 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Volume b85b0776-dbb6-4652-a6d6-c8881c1249d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2', 'volume_size': 1} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-129814632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85b0776-dbb6-4652-a6d6-c8881c1249d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566402968a1f4bce9c3e2c35626f9807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:00Z,use_quota=True,user_id='a77dcdcd9a1f4f5b85e89a5b2b06393b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Creating volume b85b0776-dbb6-4652-a6d6-c8881c1249d2 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:28:59 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:28:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:00 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2 1073741824 Sep 30 10:29:00 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:00 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2 1073741824" returned: 0 in 0.638s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:00 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2 Sep 30 10:29:00 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:00 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2" returned: 0 in 0.356s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:29:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a752804-66ea-47d2-bd1d-e660d4b627dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f37622c-7d6a-4c0d-b7db-976fc8afc66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:01 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Volume volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2 (b85b0776-dbb6-4652-a6d6-c8881c1249d2): created successfully Sep 30 10:29:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f37622c-7d6a-4c0d-b7db-976fc8afc66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Flow 'volume_create_manager' (57113d5d-c9f6-4271-9848-6d079fadcf54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:01 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c7c80ced-6674-46dd-81bf-6093aeb97fb2 tempest-VolumesTransfersTest-640416433 None] Created volume successfully. Sep 30 10:29:03 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d9623d57-46cd-4895-ad1f-b8bd96fceebe tempest-VolumesTransfersTest-1619760949 None] Transfer volume completed successfully. Sep 30 10:29:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Acquiring lock "cinder-b85b0776-dbb6-4652-a6d6-c8881c1249d2-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Lock "cinder-b85b0776-dbb6-4652-a6d6-c8881c1249d2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Acquiring lock "cinder-quobyte-b85b0776-dbb6-4652-a6d6-c8881c1249d2" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Lock "cinder-quobyte-b85b0776-dbb6-4652-a6d6-c8881c1249d2" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:04 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9b4c0d-137e-44cb-958a-2686631fe5d8]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:04 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2 Sep 30 10:29:04 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:04 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2" returned: 0 in 0.564s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:05 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2 Sep 30 10:29:05 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:05 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b85b0776-dbb6-4652-a6d6-c8881c1249d2" returned: 0 in 0.312s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Lock "cinder-quobyte-b85b0776-dbb6-4652-a6d6-c8881c1249d2" released by "delete_volume" :: held 0.973s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Created reservations ['7bd3bf06-afb9-4574-8231-d71b3bd96ff4', 'ed87c3fb-b8a9-4fa1-bb9d-78a7da40300a', 'c5427b16-a557-4ffc-97b2-08188138e812', 'e67bf481-ff1d-457c-b62f-75a0bc23e5af'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:05 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:29:05 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:05 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.448s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:29:05 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Deleted volume successfully. Sep 30 10:29:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a8c7659-804d-43d0-9c45-fc2f0b26805a tempest-VolumesTransfersTest-827843886 None] Lock "cinder-b85b0776-dbb6-4652-a6d6-c8881c1249d2-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Flow 'volume_create_manager' (e06125c4-6b75-459f-a2e0-e79f7b95f67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d8a900-5012-48e5-913e-c782dfabbb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d8a900-5012-48e5-913e-c782dfabbb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1299010022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e91c42e-ac9c-4ae1-933d-afc1eadff971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566402968a1f4bce9c3e2c35626f9807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:06Z,use_quota=True,user_id='a77dcdcd9a1f4f5b85e89a5b2b06393b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5c0774-e0f2-4d8e-b2b7-4964aba879fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5c0774-e0f2-4d8e-b2b7-4964aba879fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f0b06a-df2b-4fa5-8313-667e4c8e0d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f0b06a-df2b-4fa5-8313-667e4c8e0d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e91c42e-ac9c-4ae1-933d-afc1eadff971', 'volume_name': 'volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fd64b9-ee4d-4b89-a229-248c1abec07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fd64b9-ee4d-4b89-a229-248c1abec07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde9d053-8a0b-4f7b-a06a-a72981dd407a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:06 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Volume 4e91c42e-ac9c-4ae1-933d-afc1eadff971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971', 'volume_size': 1} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1299010022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e91c42e-ac9c-4ae1-933d-afc1eadff971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566402968a1f4bce9c3e2c35626f9807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:06Z,use_quota=True,user_id='a77dcdcd9a1f4f5b85e89a5b2b06393b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Creating volume 4e91c42e-ac9c-4ae1-933d-afc1eadff971 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:29:06 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:29:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:06 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971 1073741824 Sep 30 10:29:06 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:07 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971 1073741824" returned: 0 in 0.566s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:07 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971 Sep 30 10:29:07 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:07 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971" returned: 0 in 0.292s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde9d053-8a0b-4f7b-a06a-a72981dd407a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf9a01c-76e2-41d4-9eff-be6d357e2e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:07 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Volume volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971 (4e91c42e-ac9c-4ae1-933d-afc1eadff971): created successfully Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf9a01c-76e2-41d4-9eff-be6d357e2e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Flow 'volume_create_manager' (e06125c4-6b75-459f-a2e0-e79f7b95f67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Flow 'volume_create_manager' (d64610b5-7393-4656-807d-99763c96a30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43b2b21-3ed5-497b-9e82-c5c0006df072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:07 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-df524516-f26f-4d50-a6d7-1c74c268e0b5 tempest-VolumesTransfersTest-640416433 None] Created volume successfully. Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43b2b21-3ed5-497b-9e82-c5c0006df072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-453807297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b57217-ec26-4fb9-80be-4c08c40bb435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc03609274214144b84a6c2a7d329f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:08Z,use_quota=True,user_id='c586d6b2ffd64721a1ca7e259e5278cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943f43c5-0bda-4632-bd2d-400b5250edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943f43c5-0bda-4632-bd2d-400b5250edb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746abab1-dc8c-4d06-b7a1-1fbaf456a05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746abab1-dc8c-4d06-b7a1-1fbaf456a05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b57217-ec26-4fb9-80be-4c08c40bb435', 'volume_name': 'volume-32b57217-ec26-4fb9-80be-4c08c40bb435', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f26cad5-b3a7-4401-bd42-61c2274ea21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f26cad5-b3a7-4401-bd42-61c2274ea21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d52e7f-d20e-4a3a-b110-269f44a8633a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:07 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Volume 32b57217-ec26-4fb9-80be-4c08c40bb435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b57217-ec26-4fb9-80be-4c08c40bb435', 'volume_size': 1} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-453807297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b57217-ec26-4fb9-80be-4c08c40bb435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc03609274214144b84a6c2a7d329f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:08Z,use_quota=True,user_id='c586d6b2ffd64721a1ca7e259e5278cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Creating volume 32b57217-ec26-4fb9-80be-4c08c40bb435 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:29:07 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:29:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:07 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 1073741824 Sep 30 10:29:07 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:08 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 1073741824" returned: 0 in 0.465s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:08 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 Sep 30 10:29:08 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:08 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435" returned: 0 in 0.389s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:29:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d52e7f-d20e-4a3a-b110-269f44a8633a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b57217-ec26-4fb9-80be-4c08c40bb435', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81006223-e3ea-46cf-8597-abf63d5df583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:08 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Volume volume-32b57217-ec26-4fb9-80be-4c08c40bb435 (32b57217-ec26-4fb9-80be-4c08c40bb435): created successfully Sep 30 10:29:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81006223-e3ea-46cf-8597-abf63d5df583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Flow 'volume_create_manager' (d64610b5-7393-4656-807d-99763c96a30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:08 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-63f95ddb-d77a-4ae9-b7bc-32b5545fdafc tempest-VolumesCloneTest-1337297744 None] Created volume successfully. Sep 30 10:29:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Acquiring lock "cinder-4e91c42e-ac9c-4ae1-933d-afc1eadff971-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Lock "cinder-4e91c42e-ac9c-4ae1-933d-afc1eadff971-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Acquiring lock "cinder-quobyte-4e91c42e-ac9c-4ae1-933d-afc1eadff971" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Lock "cinder-quobyte-4e91c42e-ac9c-4ae1-933d-afc1eadff971" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:09 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bc2a49-d4b7-4832-88ce-256631eee9ff]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:09 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971 Sep 30 10:29:09 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:09 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971" returned: 0 in 0.770s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:10 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971 Sep 30 10:29:10 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:10 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4e91c42e-ac9c-4ae1-933d-afc1eadff971" returned: 0 in 0.595s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Lock "cinder-quobyte-4e91c42e-ac9c-4ae1-933d-afc1eadff971" released by "delete_volume" :: held 1.439s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:10 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Created reservations ['e3bd43d3-cd5d-402f-9317-f1f132d3a5a3', '72bf7526-4989-4a51-94b3-30c7bbcbcd01', '068f901b-b163-4743-97f2-5682dba909e1', '5b09f253-0f77-4738-957e-17d9176a2735'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:29:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:10 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:29:10 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Flow 'volume_create_manager' (717964f5-91fd-4e08-af1d-6c48fb9e21f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a7fbe6-1bd9-4223-9d7a-30c4a178ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a7fbe6-1bd9-4223-9d7a-30c4a178ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-918008889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa35212-b5c7-4b68-bf9c-db7a39568269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc03609274214144b84a6c2a7d329f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=32b57217-ec26-4fb9-80be-4c08c40bb435,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:11Z,use_quota=True,user_id='c586d6b2ffd64721a1ca7e259e5278cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbe0400-aa6b-4562-8b77-5202028db243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbe0400-aa6b-4562-8b77-5202028db243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f820d9ea-4a0f-45dc-98d2-8f4fa1b36ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f820d9ea-4a0f-45dc-98d2-8f4fa1b36ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2fa35212-b5c7-4b68-bf9c-db7a39568269', 'volume_name': 'volume-2fa35212-b5c7-4b68-bf9c-db7a39568269', 'volume_size': 2, 'source_volid': '32b57217-ec26-4fb9-80be-4c08c40bb435', 'source_volstatus': 'available'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0cc835-bf20-4377-9292-77fead18ca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:11 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0cc835-bf20-4377-9292-77fead18ca7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e25449-8a9e-46ec-af95-7b4563be06e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:11 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Volume 2fa35212-b5c7-4b68-bf9c-db7a39568269: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2fa35212-b5c7-4b68-bf9c-db7a39568269', 'volume_size': 2, 'source_volid': '32b57217-ec26-4fb9-80be-4c08c40bb435', 'source_volstatus': 'available'} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.421s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:29:11 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Deleted volume successfully. Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:11 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Cloning volume 32b57217-ec26-4fb9-80be-4c08c40bb435 to volume 2fa35212-b5c7-4b68-bf9c-db7a39568269 Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b61f7725-04cc-453e-885c-3a63543c32b4 tempest-VolumesTransfersTest-827843886 None] Lock "cinder-4e91c42e-ac9c-4ae1-933d-afc1eadff971-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Creating offline snapshot 778fcafe-7373-491e-927d-30cba0965cd9 of volume 32b57217-ec26-4fb9-80be-4c08c40bb435 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eb5ca2-1c10-40a0-851d-c27fc3c7b62f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:11 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 Sep 30 10:29:11 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:12 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435" returned: 0 in 0.668s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:12 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 1G Sep 30 10:29:12 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:12 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 1G" returned: 0 in 0.606s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b57217-ec26-4fb9-80be-4c08c40bb435 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:12 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b57217-ec26-4fb9-80be-4c08c40bb435 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 Sep 30 10:29:12 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:13 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b57217-ec26-4fb9-80be-4c08c40bb435 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9" returned: 0 in 0.408s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:13 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 is being set with open permissions: ugo+rw Sep 30 10:29:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:13 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 Sep 30 10:29:13 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:13 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9" returned: 0 in 0.343s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:13 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.info Sep 30 10:29:13 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:13 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.info" returned: 0 in 0.342s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:13 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.info is being set with open permissions: ugo+rw Sep 30 10:29:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:13 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.info Sep 30 10:29:13 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:14 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.info" returned: 0 in 0.409s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Acquiring lock "cinder-quobyte-2fa35212-b5c7-4b68-bf9c-db7a39568269" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Lock "cinder-quobyte-2fa35212-b5c7-4b68-bf9c-db7a39568269" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] snapshot: 778fcafe-7373-491e-927d-30cba0965cd9, volume: 2fa35212-b5c7-4b68-bf9c-db7a39568269, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e38048-4608-414c-9f98-c94ba4dcfc46]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:14 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 Sep 30 10:29:14 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:15 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9" returned: 0 in 0.553s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b57217-ec26-4fb9-80be-4c08c40bb435(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:29:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[54463373-520e-4ebb-af84-9cb90341bdeb]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:15 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 Sep 30 10:29:15 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:15 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-5c71caf1-dbcc-430e-8ced-44be4420e3ff req-c92c4737-fda1-4b38-99df-2b4450dc7990 tempest-AttachVolumeNegativeTest-1648356732 None] Terminate volume connection completed successfully. Sep 30 10:29:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-5c71caf1-dbcc-430e-8ced-44be4420e3ff req-c92c4737-fda1-4b38-99df-2b4450dc7990 tempest-AttachVolumeNegativeTest-1648356732 None] Deleting attachment 60105a01-3a61-4e42-b7f5-a7d8092f875c. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:29:15 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435" returned: 0 in 0.466s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:29:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:29:15 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:29:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:15 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 Sep 30 10:29:15 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:23 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=76,cinder:UPDATE=88,cinder:INSERT=18,cinder:DELETE=11 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:29:25 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269" returned: 0 in 9.506s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435, size 1024.00 MB, duration 9.51 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:29:25 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Converted 1024.00 MB image at 107.71 MB/s Sep 30 10:29:25 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 is being set with open permissions: ugo+rw Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:25 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 Sep 30 10:29:25 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:25 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269" returned: 0 in 0.300s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Lock "cinder-quobyte-2fa35212-b5c7-4b68-bf9c-db7a39568269" released by "_copy_volume_from_snapshot" :: held 10.941s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Acquiring lock "cinder-quobyte-778fcafe-7373-491e-927d-30cba0965cd9" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Lock "cinder-quobyte-778fcafe-7373-491e-927d-30cba0965cd9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Deleting offline snapshot 778fcafe-7373-491e-927d-30cba0965cd9 of volume 32b57217-ec26-4fb9-80be-4c08c40bb435 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] snapshot_file for this snap is: volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd1c50b-6cd4-404e-9e7e-456c311a45a8]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:25 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 Sep 30 10:29:25 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:25 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9" returned: 0 in 0.443s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b57217-ec26-4fb9-80be-4c08c40bb435(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b509d10-8739-4a73-9d5a-c4da4f7c5cff]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:26 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 Sep 30 10:29:26 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:26 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435" returned: 0 in 0.682s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:26 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 Sep 30 10:29:26 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:27 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9" returned: 0 in 0.486s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:27 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9 Sep 30 10:29:27 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:27 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435.778fcafe-7373-491e-927d-30cba0965cd9" returned: 0 in 0.277s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Lock "cinder-quobyte-778fcafe-7373-491e-927d-30cba0965cd9" released by "_delete_snapshot" :: held 2.028s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.083s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e25449-8a9e-46ec-af95-7b4563be06e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa35212-b5c7-4b68-bf9c-db7a39568269', 'volume_size': 2, 'source_volid': '32b57217-ec26-4fb9-80be-4c08c40bb435', 'source_volstatus': 'available'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1780beeb-0ea5-4f78-81fa-9ef5b74cf982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:27 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Volume volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 (2fa35212-b5c7-4b68-bf9c-db7a39568269): created successfully Sep 30 10:29:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1780beeb-0ea5-4f78-81fa-9ef5b74cf982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Flow 'volume_create_manager' (717964f5-91fd-4e08-af1d-6c48fb9e21f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:27 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7cf06047-84c6-4657-b7f0-6634b93a86df tempest-VolumesCloneTest-1337297744 None] Created volume successfully. Sep 30 10:29:27 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-713b1a49-01c1-4498-be6c-e63c8fcf1a61 req-4672d71d-0659-49ec-bad8-472785f7bec9 tempest-ServerActionsTestOtherA-342232922 None] Terminate volume connection completed successfully. Sep 30 10:29:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-713b1a49-01c1-4498-be6c-e63c8fcf1a61 req-4672d71d-0659-49ec-bad8-472785f7bec9 tempest-ServerActionsTestOtherA-342232922 None] Deleting attachment 53f2e50f-a0a6-4606-8a68-02123a02aeaa. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:29:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Acquiring lock "cinder-2fa35212-b5c7-4b68-bf9c-db7a39568269-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Lock "cinder-2fa35212-b5c7-4b68-bf9c-db7a39568269-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Acquiring lock "cinder-quobyte-2fa35212-b5c7-4b68-bf9c-db7a39568269" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Lock "cinder-quobyte-2fa35212-b5c7-4b68-bf9c-db7a39568269" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:28 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a6b400-dfbf-4db1-a562-aaf0be8b942a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:28 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 Sep 30 10:29:28 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:29 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269" returned: 0 in 0.829s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:29 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269 Sep 30 10:29:29 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:29 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2fa35212-b5c7-4b68-bf9c-db7a39568269" returned: 0 in 0.471s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Lock "cinder-quobyte-2fa35212-b5c7-4b68-bf9c-db7a39568269" released by "delete_volume" :: held 1.389s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Created reservations ['8e2d8e84-62a3-48a7-be4e-d2686ac8d984', '486e4c4f-8e4d-4b3b-9dec-41a70e6ddabf', 'ce81dd61-c0f2-4153-a6e3-7a52e3ed3ed6', 'df25cb02-202f-45f6-b984-197687bff02f'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:29 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:29:29 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:30 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.321s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:30 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:29:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Deleted volume successfully. Sep 30 10:29:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2c2f084-20f7-4da2-9463-b15d345fa00c tempest-VolumesCloneTest-1337297744 None] Lock "cinder-2fa35212-b5c7-4b68-bf9c-db7a39568269-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Acquiring lock "cinder-32b57217-ec26-4fb9-80be-4c08c40bb435-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Lock "cinder-32b57217-ec26-4fb9-80be-4c08c40bb435-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Acquiring lock "cinder-quobyte-32b57217-ec26-4fb9-80be-4c08c40bb435" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Lock "cinder-quobyte-32b57217-ec26-4fb9-80be-4c08c40bb435" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:30 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e299d4a6-ca63-4203-8c0e-eaf560a4ee5b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:31 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 Sep 30 10:29:31 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:31 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435" returned: 0 in 0.544s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:31 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435 Sep 30 10:29:31 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:31 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-32b57217-ec26-4fb9-80be-4c08c40bb435" returned: 0 in 0.308s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Lock "cinder-quobyte-32b57217-ec26-4fb9-80be-4c08c40bb435" released by "delete_volume" :: held 0.948s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Created reservations ['d55dbb33-abd2-45dd-953e-02c07e400c63', 'd8228bda-4114-41df-99bc-cf2c12a8ded8', '6aee998f-885f-4be9-bed7-2fe32734e5ee', '7c082936-421c-4c28-84ad-ac8496f9b747'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:31 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:29:31 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:32 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.307s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:32 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:29:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Deleted volume successfully. Sep 30 10:29:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ade2463f-99bb-45e4-a96c-86ba83bd69d0 tempest-VolumesCloneTest-1337297744 None] Lock "cinder-32b57217-ec26-4fb9-80be-4c08c40bb435-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=88,cinder:INSERT=29,cinder:UPDATE=107,cinder:DELETE=2 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Flow 'volume_create_manager' (eecf0e41-5f81-4fc5-85d3-846dd41bd9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c59f39-fb22-4df0-8a28-4ac3e4c88920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c59f39-fb22-4df0-8a28-4ac3e4c88920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-478198228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef767bc3-30d6-49f4-9ad6-67f9523e92d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146bc5e0a0d843e697a792e7f274f401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:35Z,use_quota=True,user_id='07d447c641a84926a837ec69805d5a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4401a0-b12c-42b7-bc0a-1bf6dd899295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4401a0-b12c-42b7-bc0a-1bf6dd899295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b5139e-dd4b-4789-aed0-aab6b7a5978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b5139e-dd4b-4789-aed0-aab6b7a5978a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef767bc3-30d6-49f4-9ad6-67f9523e92d9', 'volume_name': 'volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c2d01c-4f47-43e1-b613-623cb24ed42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c2d01c-4f47-43e1-b613-623cb24ed42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3c3624-df9b-4026-ba45-7cfc55cf1f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:35 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Volume ef767bc3-30d6-49f4-9ad6-67f9523e92d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9', 'volume_size': 1} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-478198228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef767bc3-30d6-49f4-9ad6-67f9523e92d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146bc5e0a0d843e697a792e7f274f401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:35Z,use_quota=True,user_id='07d447c641a84926a837ec69805d5a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Creating volume ef767bc3-30d6-49f4-9ad6-67f9523e92d9 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:29:35 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:29:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:35 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 1073741824 Sep 30 10:29:35 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:36 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 1073741824" returned: 0 in 0.728s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:36 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 Sep 30 10:29:36 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:36 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" returned: 0 in 0.398s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:29:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3c3624-df9b-4026-ba45-7cfc55cf1f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8a88c1-bcbc-4100-b4ce-b8ac95414f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:36 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Volume volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 (ef767bc3-30d6-49f4-9ad6-67f9523e92d9): created successfully Sep 30 10:29:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8a88c1-bcbc-4100-b4ce-b8ac95414f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Flow 'volume_create_manager' (eecf0e41-5f81-4fc5-85d3-846dd41bd9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:37 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f12bd011-4601-4248-834d-061baffce86f tempest-VolumesActionsTest-1191574243 None] Created volume successfully. Sep 30 10:29:37 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:29:37 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:37 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.332s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 28 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:29:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:29:38 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:29:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Flow 'volume_create_manager' (fdc2c5b6-7fb9-4631-b174-7eeda94a9e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc65804-70d5-4f06-94b3-bfdfe56e1ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc65804-70d5-4f06-94b3-bfdfe56e1ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-582779653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a9ca9a-e371-43ca-a9a7-1190523b8727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b92a5afafa47db957c0effe3ebd96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:38Z,use_quota=True,user_id='e0c774a286444489b6d1fbbab81adc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8f23c1-8b31-4606-b7b6-9a561df5494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8f23c1-8b31-4606-b7b6-9a561df5494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d03755-3f8b-41f8-9d40-cd320d66eecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:38 devstack cinder-volume[87013]: DEBUG cinder.image.glance [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Creating Keystone auth plugin from conf {{(pid=87013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 10:29:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d03755-3f8b-41f8-9d40-cd320d66eecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '44a9ca9a-e371-43ca-a9a7-1190523b8727', 'volume_name': 'volume-44a9ca9a-e371-43ca-a9a7-1190523b8727', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9ea63e-a309-4e66-809e-39a1eaf2fe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9ea63e-a309-4e66-809e-39a1eaf2fe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5088074f-629e-4a24-9958-6176a1124a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:39 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Volume 44a9ca9a-e371-43ca-a9a7-1190523b8727: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-44a9ca9a-e371-43ca-a9a7-1190523b8727', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 10:29:39 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Trying to clone 44a9ca9a-e371-43ca-a9a7-1190523b8727 from image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]). {{(pid=87013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 10:29:40 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 10:29:40 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Image download 20.69 MB at 20.69 MB/s Sep 30 10:29:40 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81ede9e-c12e-41ca-b774-5c3f2066f4f5]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:40 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD Sep 30 10:29:40 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:40 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD" returned: 0 in 0.624s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:40 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Temporary image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e is fetched for user e0c774a286444489b6d1fbbab81adc5d. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c5f231-fbdc-48a6-8c96-81475a31fcc0]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:41 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD Sep 30 10:29:41 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:41 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-582779653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a9ca9a-e371-43ca-a9a7-1190523b8727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b92a5afafa47db957c0effe3ebd96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:38Z,use_quota=True,user_id='e0c774a286444489b6d1fbbab81adc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Creating volume 44a9ca9a-e371-43ca-a9a7-1190523b8727 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:29:41 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:29:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:41 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 1073741824 Sep 30 10:29:41 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:42 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 1073741824" returned: 0 in 0.963s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:42 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 Sep 30 10:29:42 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:43 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727" returned: 0 in 0.601s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:29:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:43 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Attempting download of 0e96b9f2-4ae9-48ec-8d88-8e11a591034e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}])) to volume 44a9ca9a-e371-43ca-a9a7-1190523b8727. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 10:29:43 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[689329c5-e3d1-44c5-96d1-3a4d654142bc]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_09euzwc4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:43 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_09euzwc4 Sep 30 10:29:43 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:43 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_09euzwc4" returned: 0 in 0.441s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_09euzwc4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:44 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_09euzwc4 Sep 30 10:29:44 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:44 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_09euzwc4" returned: 1 in 0.519s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_09euzwc4' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:29:44 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f20843-bca0-4bf3-853a-adb289f92d97]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:44 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD Sep 30 10:29:44 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:45 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:45 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] 0e96b9f2-4ae9-48ec-8d88-8e11a591034e was qcow2, converting to qcow2 {{(pid=87013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 10:29:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:45 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 Sep 30 10:29:45 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Flow 'volume_create_manager' (e17f30a2-c066-42c8-a35f-38f561001d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81a44a8-4ac2-43d4-b343-baa8f8865a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81a44a8-4ac2-43d4-b343-baa8f8865a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1056405242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e4e622-fe38-4698-bf8c-c9c8a55c7ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1666ee67fa543799da4a60c0aea1528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:46Z,use_quota=True,user_id='5636e4ca596e4da6a6b1be3a40719045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbed0927-d505-4e95-8ee3-23e8cf24d616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbed0927-d505-4e95-8ee3-23e8cf24d616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6acc0ab-521e-4e60-b181-e33931313b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6acc0ab-521e-4e60-b181-e33931313b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e4e622-fe38-4698-bf8c-c9c8a55c7ecf', 'volume_name': 'volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f3df2a-7314-489e-ac83-f717f1af5534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f3df2a-7314-489e-ac83-f717f1af5534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf440b4-fd4b-4669-8a2f-ec0827091b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:46 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Volume 15e4e622-fe38-4698-bf8c-c9c8a55c7ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf', 'volume_size': 1} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1056405242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e4e622-fe38-4698-bf8c-c9c8a55c7ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1666ee67fa543799da4a60c0aea1528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:29:46Z,use_quota=True,user_id='5636e4ca596e4da6a6b1be3a40719045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Creating volume 15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:29:46 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:29:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:46 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf 1073741824 Sep 30 10:29:46 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:47 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf 1073741824" returned: 0 in 1.261s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:47 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf Sep 30 10:29:47 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:48 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" returned: 0 in 0.872s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:29:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf440b4-fd4b-4669-8a2f-ec0827091b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f76e8cb-b207-4d41-b19d-6674b54deaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:48 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Volume volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf (15e4e622-fe38-4698-bf8c-c9c8a55c7ecf): created successfully Sep 30 10:29:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f76e8cb-b207-4d41-b19d-6674b54deaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Flow 'volume_create_manager' (e17f30a2-c066-42c8-a35f-38f561001d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:48 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-6a296e8d-951e-4d27-a6f6-c3cc9e2a4f06 tempest-VolumesSnapshotListTestJSON-1580141428 None] Created volume successfully. Sep 30 10:29:48 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727" returned: 0 in 3.670s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:48 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_e1vqr8ahdevstack@QuobyteHD, size 112.00 MB, duration 3.67 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:29:48 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Converted 112.00 MB image at 30.50 MB/s Sep 30 10:29:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:48 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 1G Sep 30 10:29:48 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:49 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 1G" returned: 0 in 0.436s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Downloaded image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}])) to volume 44a9ca9a-e371-43ca-a9a7-1190523b8727 successfully. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Temporary image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e for user e0c774a286444489b6d1fbbab81adc5d is deleted. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Marking volume 44a9ca9a-e371-43ca-a9a7-1190523b8727 as bootable. {{(pid=87013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Copying metadata from image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e to 44a9ca9a-e371-43ca-a9a7-1190523b8727. {{(pid=87013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Creating volume glance metadata for volume 44a9ca9a-e371-43ca-a9a7-1190523b8727 backed by image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5088074f-629e-4a24-9958-6176a1124a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a9ca9a-e371-43ca-a9a7-1190523b8727', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe349a0a-11db-47de-9e16-3facdda15293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:29:49 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Volume volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 (44a9ca9a-e371-43ca-a9a7-1190523b8727): created successfully Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe349a0a-11db-47de-9e16-3facdda15293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Flow 'volume_create_manager' (fdc2c5b6-7fb9-4631-b174-7eeda94a9e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:29:49 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0337d671-0fd5-410f-b4c5-96597f2ceb11 tempest-ServerActionsTestOtherA-342232922 None] Created volume successfully. Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Creating offline snapshot 66d4b7cd-2461-475d-84b6-bd5bb2567061 of volume 15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[916c8c39-4c87-4118-adce-db1da6656f7d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:49 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf Sep 30 10:29:49 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:50 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" returned: 0 in 0.622s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:50 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 1G Sep 30 10:29:50 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:51 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 1G" returned: 0 in 0.943s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:51 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 Sep 30 10:29:51 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:51 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061" returned: 0 in 0.421s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:51 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 is being set with open permissions: ugo+rw Sep 30 10:29:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:51 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 Sep 30 10:29:51 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:52 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061" returned: 0 in 0.429s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:52 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.info Sep 30 10:29:52 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5eab613b-25fc-472b-9c43-62ce18843846 tempest-VolumesActionsTest-1191574243 None] Acquiring lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" by "attach_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5eab613b-25fc-472b-9c43-62ce18843846 tempest-VolumesActionsTest-1191574243 None] Lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" acquired by "attach_volume" :: waited 0.039s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-5eab613b-25fc-472b-9c43-62ce18843846 tempest-VolumesActionsTest-1191574243 None] Attaching volume ef767bc3-30d6-49f4-9ad6-67f9523e92d9 to instance fcbe000c-3871-4436-b51e-9c15b5eeaa3d at mountpoint /dev/vdb on host None. Sep 30 10:29:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-5eab613b-25fc-472b-9c43-62ce18843846 tempest-VolumesActionsTest-1191574243 None] Attach volume completed successfully. Sep 30 10:29:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5eab613b-25fc-472b-9c43-62ce18843846 tempest-VolumesActionsTest-1191574243 None] Lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" released by "attach_volume" :: held 0.197s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:52 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.info" returned: 0 in 0.538s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:52 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.info is being set with open permissions: ugo+rw Sep 30 10:29:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:52 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.info Sep 30 10:29:52 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-470a5848-dd4b-4c91-b52e-264d4ad6980f tempest-VolumesActionsTest-1191574243 None] Acquiring lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9-detach_volume" by "detach_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:29:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-470a5848-dd4b-4c91-b52e-264d4ad6980f tempest-VolumesActionsTest-1191574243 None] Lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:29:53 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-470a5848-dd4b-4c91-b52e-264d4ad6980f tempest-VolumesActionsTest-1191574243 None] Detaching volume ef767bc3-30d6-49f4-9ad6-67f9523e92d9 from instance fcbe000c-3871-4436-b51e-9c15b5eeaa3d. Sep 30 10:29:53 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-470a5848-dd4b-4c91-b52e-264d4ad6980f tempest-VolumesActionsTest-1191574243 None] Detach volume completed successfully. Sep 30 10:29:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-470a5848-dd4b-4c91-b52e-264d4ad6980f tempest-VolumesActionsTest-1191574243 None] Lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:29:53 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.info" returned: 0 in 0.442s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.594s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:53 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-cea855db-a41c-4aa5-9777-012dc2bf01bc tempest-VolumesSnapshotListTestJSON-1580141428 None] Create snapshot completed successfully Sep 30 10:29:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] Creating offline snapshot 30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 of volume 15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:29:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-38398220-996f-49bf-af28-e7b0d3557990 req-9f018c1b-06c7-4bd8-ada2-d4f5f3ff9cc0 tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7118d100-72ad-49b4-9566-b94439335dd0]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:55 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 Sep 30 10:29:55 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:55 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061" returned: 0 in 0.625s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:29:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:55 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 1G Sep 30 10:29:55 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:56 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 1G" returned: 0 in 0.869s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:56 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 Sep 30 10:29:56 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:56 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62" returned: 0 in 0.426s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:56 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 is being set with open permissions: ugo+rw Sep 30 10:29:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:56 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 Sep 30 10:29:56 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:57 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62" returned: 0 in 0.257s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-38398220-996f-49bf-af28-e7b0d3557990 req-9f018c1b-06c7-4bd8-ada2-d4f5f3ff9cc0 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.248s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-38398220-996f-49bf-af28-e7b0d3557990 req-9f018c1b-06c7-4bd8-ada2-d4f5f3ff9cc0 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:29:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-aeb511ef-3930-4198-b0e8-e396182520df tempest-VolumesSnapshotListTestJSON-1580141428 None] Create snapshot completed successfully Sep 30 10:29:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-38398220-996f-49bf-af28-e7b0d3557990 req-9f018c1b-06c7-4bd8-ada2-d4f5f3ff9cc0 tempest-ServerActionsTestOtherA-342232922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-44a9ca9a-e371-43ca-a9a7-1190523b8727', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c24d3a9b-1abb-48d6-b980-21fcd63bf220', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:29:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-38398220-996f-49bf-af28-e7b0d3557990 req-9f018c1b-06c7-4bd8-ada2-d4f5f3ff9cc0 tempest-ServerActionsTestOtherA-342232922 None] attachment_update completed successfully. Sep 30 10:29:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:29:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:29:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] Creating offline snapshot f6f428e5-ef09-4357-a8a6-c908255ebc52 of volume 15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:29:58 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69e4f03-6903-4fa6-991d-dba5eff4472b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:29:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:58 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 Sep 30 10:29:58 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:59 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62" returned: 0 in 0.750s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:29:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:59 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 1G Sep 30 10:29:59 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:29:59 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 30 10:29:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 1G" returned: 0 in 0.719s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:29:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:29:59 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 Sep 30 10:29:59 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:00 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52" returned: 0 in 0.476s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:00 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 is being set with open permissions: ugo+rw Sep 30 10:30:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:00 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 Sep 30 10:30:00 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:00 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52" returned: 0 in 0.379s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:30:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f4825106-b7b9-45d1-91fd-f467a1525708 tempest-VolumesSnapshotListTestJSON-1580141428 None] Create snapshot completed successfully Sep 30 10:30:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-f6f428e5-ef09-4357-a8a6-c908255ebc52-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-f6f428e5-ef09-4357-a8a6-c908255ebc52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-quobyte-f6f428e5-ef09-4357-a8a6-c908255ebc52" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-f6f428e5-ef09-4357-a8a6-c908255ebc52" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Deleting offline snapshot f6f428e5-ef09-4357-a8a6-c908255ebc52 of volume 15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:30:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] snapshot_file for this snap is: volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:30:02 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be4e14-28bf-44a1-b1d0-34dec468a906]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:30:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:03 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 Sep 30 10:30:03 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:03 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52" returned: 0 in 0.658s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:30:03 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4be833-5488-4ebc-bf30-c86d80d70d78]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:30:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:03 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 Sep 30 10:30:03 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:04 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62" returned: 0 in 0.718s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:30:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:04 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 Sep 30 10:30:04 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:05 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52" returned: 0 in 1.410s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:05 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52 Sep 30 10:30:05 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:06 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.f6f428e5-ef09-4357-a8a6-c908255ebc52" returned: 0 in 0.562s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-f6f428e5-ef09-4357-a8a6-c908255ebc52" released by "_delete_snapshot" :: held 3.567s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" released by "delete_snapshot" :: held 3.616s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:06 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Created reservations ['a2f2c4dd-5153-46ef-8d4e-e2c300dc2535', 'e9a1cf69-684b-439b-8181-bf33a956cf73', '4126eb56-181e-4c5e-87bd-c845a314c4c8', 'a96282f5-8ba0-4a3c-a753-2d83d183ca33'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:30:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Delete snapshot completed successfully. Sep 30 10:30:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f6395cd-3bf0-4aad-9860-3e636696a9dc tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-f6f428e5-ef09-4357-a8a6-c908255ebc52-delete_snapshot" released by "delete_snapshot" :: held 3.933s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-quobyte-30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Deleting offline snapshot 30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 of volume 15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:30:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] snapshot_file for this snap is: volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:30:07 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[06da8048-8019-481d-b7ea-473ba35869fe]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:30:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:07 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 Sep 30 10:30:07 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Flow 'volume_create_manager' (14dc1e75-e9a1-47cd-879c-401edb1cd005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6933d36a-3a08-40df-b269-9cb7b30e54cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6933d36a-3a08-40df-b269-9cb7b30e54cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-429748480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ab3119-3625-4e85-8479-3b676b9e6f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a18464bd6094392984c61f5b8812621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:30:08Z,use_quota=True,user_id='af30d8e8377e4b34b35b093e599a542f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d06fcb-be18-4416-bf61-536885dab32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d06fcb-be18-4416-bf61-536885dab32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956502f9-81d1-4436-b9a8-ea40240319a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956502f9-81d1-4436-b9a8-ea40240319a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ab3119-3625-4e85-8479-3b676b9e6f55', 'volume_name': 'volume-d2ab3119-3625-4e85-8479-3b676b9e6f55', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5745495-b633-4480-9c01-d275306c83ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5745495-b633-4480-9c01-d275306c83ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c24319f-c623-44da-9b4c-5e948020bf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:30:08 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Volume d2ab3119-3625-4e85-8479-3b676b9e6f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ab3119-3625-4e85-8479-3b676b9e6f55', 'volume_size': 1} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-429748480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ab3119-3625-4e85-8479-3b676b9e6f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a18464bd6094392984c61f5b8812621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:30:08Z,use_quota=True,user_id='af30d8e8377e4b34b35b093e599a542f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Creating volume d2ab3119-3625-4e85-8479-3b676b9e6f55 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:30:08 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:08 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62" returned: 0 in 0.756s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:30:08 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55 1073741824 Sep 30 10:30:08 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[902e3e2d-db5a-4038-b22d-c9bb88f1c39d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:30:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:08 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 Sep 30 10:30:08 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:09 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55 1073741824" returned: 0 in 1.077s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:09 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55 Sep 30 10:30:09 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:09 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061" returned: 0 in 1.230s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:30:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:09 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 Sep 30 10:30:09 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:10 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55" returned: 0 in 0.544s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:30:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:30:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c24319f-c623-44da-9b4c-5e948020bf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ab3119-3625-4e85-8479-3b676b9e6f55', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:30:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206b889b-0a98-493d-a5f1-c3b3efda5eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:30:10 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Volume volume-d2ab3119-3625-4e85-8479-3b676b9e6f55 (d2ab3119-3625-4e85-8479-3b676b9e6f55): created successfully Sep 30 10:30:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206b889b-0a98-493d-a5f1-c3b3efda5eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:30:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Flow 'volume_create_manager' (14dc1e75-e9a1-47cd-879c-401edb1cd005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:30:10 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2bf67085-103f-4d78-be0b-9002a8294005 tempest-AttachVolumeNegativeTest-1648356732 None] Created volume successfully. Sep 30 10:30:10 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62" returned: 0 in 0.694s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:10 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62 Sep 30 10:30:10 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:11 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62" returned: 0 in 0.565s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62" released by "_delete_snapshot" :: held 3.554s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" released by "delete_snapshot" :: held 3.606s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:11 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Created reservations ['47ff27ba-3b42-4069-bd8e-aad54b9771b6', '4b4fd87a-380b-41a6-9c2e-3a95ab419acf', 'aee934fb-da78-49e7-8b83-7e1995e63a14', 'b86bccab-7492-466a-8c38-17c1a936e29c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:30:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b12724ae-0703-40be-bb13-aee069757c7f tempest-VolumesActionsTest-1191574243 None] Acquiring lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" by "attach_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b12724ae-0703-40be-bb13-aee069757c7f tempest-VolumesActionsTest-1191574243 None] Lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" acquired by "attach_volume" :: waited 0.044s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:11 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Delete snapshot completed successfully. Sep 30 10:30:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39108005-ec40-4c23-b005-19d63145c713 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-30f2a5cd-07a5-47d1-a3e5-4fa4bc8f1a62-delete_snapshot" released by "delete_snapshot" :: held 4.215s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:11 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b12724ae-0703-40be-bb13-aee069757c7f tempest-VolumesActionsTest-1191574243 None] Attaching volume ef767bc3-30d6-49f4-9ad6-67f9523e92d9 to instance 1c4e868e-a62e-4ace-986a-43c1aa54ba08 at mountpoint /dev/vdb on host None. Sep 30 10:30:11 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b12724ae-0703-40be-bb13-aee069757c7f tempest-VolumesActionsTest-1191574243 None] Attach volume completed successfully. Sep 30 10:30:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b12724ae-0703-40be-bb13-aee069757c7f tempest-VolumesActionsTest-1191574243 None] Lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" released by "attach_volume" :: held 0.358s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-66d4b7cd-2461-475d-84b6-bd5bb2567061-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-66d4b7cd-2461-475d-84b6-bd5bb2567061-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-quobyte-66d4b7cd-2461-475d-84b6-bd5bb2567061" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-66d4b7cd-2461-475d-84b6-bd5bb2567061" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Deleting offline snapshot 66d4b7cd-2461-475d-84b6-bd5bb2567061 of volume 15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] snapshot_file for this snap is: volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c26f157-0e8d-4029-adcd-b01482684737]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:12 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 Sep 30 10:30:12 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d2c10c18-8479-4db0-bf26-8b12faa58f60 tempest-VolumesActionsTest-1191574243 None] Acquiring lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9-detach_volume" by "detach_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d2c10c18-8479-4db0-bf26-8b12faa58f60 tempest-VolumesActionsTest-1191574243 None] Lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d2c10c18-8479-4db0-bf26-8b12faa58f60 tempest-VolumesActionsTest-1191574243 None] Detaching volume ef767bc3-30d6-49f4-9ad6-67f9523e92d9 from instance 1c4e868e-a62e-4ace-986a-43c1aa54ba08. Sep 30 10:30:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d8391933-6106-481f-88d9-04b2e3a6c9f6 req-c83ea5d5-f908-4293-8952-513ff8bb26b6 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:30:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d8391933-6106-481f-88d9-04b2e3a6c9f6 req-c83ea5d5-f908-4293-8952-513ff8bb26b6 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:30:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d8391933-6106-481f-88d9-04b2e3a6c9f6 req-c83ea5d5-f908-4293-8952-513ff8bb26b6 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:30:13 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d2c10c18-8479-4db0-bf26-8b12faa58f60 tempest-VolumesActionsTest-1191574243 None] Detach volume completed successfully. Sep 30 10:30:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d8391933-6106-481f-88d9-04b2e3a6c9f6 req-c83ea5d5-f908-4293-8952-513ff8bb26b6 tempest-AttachVolumeNegativeTest-1648356732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-d2ab3119-3625-4e85-8479-3b676b9e6f55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e1872ad-7767-4330-8ab8-bbf6164c5b75', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:30:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d2c10c18-8479-4db0-bf26-8b12faa58f60 tempest-VolumesActionsTest-1191574243 None] Lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9-detach_volume" released by "detach_volume" :: held 0.315s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:13 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-d8391933-6106-481f-88d9-04b2e3a6c9f6 req-c83ea5d5-f908-4293-8952-513ff8bb26b6 tempest-AttachVolumeNegativeTest-1648356732 None] attachment_update completed successfully. Sep 30 10:30:13 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061" returned: 0 in 1.284s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:30:13 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[076be940-1915-4611-861f-b100ffb552c9]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:30:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:13 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf Sep 30 10:30:13 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:14 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" returned: 0 in 1.113s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:14 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 Sep 30 10:30:14 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:15 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061" returned: 0 in 1.145s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:16 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061 Sep 30 10:30:16 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:16 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf.66d4b7cd-2461-475d-84b6-bd5bb2567061" returned: 0 in 0.667s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-66d4b7cd-2461-475d-84b6-bd5bb2567061" released by "_delete_snapshot" :: held 4.597s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" released by "delete_snapshot" :: held 4.671s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:17 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Created reservations ['bcf9ca6a-3874-45ae-a9be-36e996370ae5', '2912d653-727d-43f0-a35f-77730f8ff219', '92917b4e-3edc-4026-8ce3-8ab7d8a9eb27', '75d8568e-706b-4251-bfd7-000cdd377c70'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:30:17 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Delete snapshot completed successfully. Sep 30 10:30:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed04f8e9-df94-4798-a426-acde669cb0cd tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-66d4b7cd-2461-475d-84b6-bd5bb2567061-delete_snapshot" released by "delete_snapshot" :: held 5.144s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:18 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-4a31f973-24b4-4d80-a0b5-15ff790ffef8 req-b17697ad-4b5c-4e72-a1c7-39399de1db66 tempest-AttachVolumeNegativeTest-1648356732 None] Terminate volume connection completed successfully. Sep 30 10:30:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-4a31f973-24b4-4d80-a0b5-15ff790ffef8 req-b17697ad-4b5c-4e72-a1c7-39399de1db66 tempest-AttachVolumeNegativeTest-1648356732 None] Deleting attachment 0e1872ad-7767-4330-8ab8-bbf6164c5b75. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:30:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:30:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:30:18 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea76b90-30fb-4bf2-bbdf-90e137121c88]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:30:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:18 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf Sep 30 10:30:18 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:19 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" returned: 0 in 0.623s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:19 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf Sep 30 10:30:19 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:19 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-c1286920-524b-42cd-b731-60240b2c129b req-dcf0da30-beee-4cbf-b07c-3408ce2be1ea tempest-ServerActionsTestOtherA-342232922 None] Terminate volume connection completed successfully. Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-c1286920-524b-42cd-b731-60240b2c129b req-dcf0da30-beee-4cbf-b07c-3408ce2be1ea tempest-ServerActionsTestOtherA-342232922 None] Deleting attachment c24d3a9b-1abb-48d6-b980-21fcd63bf220. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:30:19 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" returned: 0 in 0.438s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-quobyte-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf" released by "delete_volume" :: held 1.172s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Created reservations ['b202dbed-25c6-4c51-8f10-348290b843a1', '13f8a4ca-3429-4d73-a82b-4991a6c1a930', '1cb7099a-888a-463e-be59-55ce06a3e713', '48036515-89d7-4069-b3d3-f5bda6ad2f1c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:30:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:19 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:30:19 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:20 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.402s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:20 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:30:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Deleted volume successfully. Sep 30 10:30:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5dd6195-85a2-4f99-af9f-fa151cb405c5 tempest-VolumesSnapshotListTestJSON-1580141428 None] Lock "cinder-15e4e622-fe38-4698-bf8c-c9c8a55c7ecf-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:30:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:30:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:30:20 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4db5d23-f971-4b90-a685-d06a2b5ea113]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:30:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:21 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 Sep 30 10:30:21 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:21 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" returned: 0 in 0.486s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:21 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab0a42e-3fe9-4b3e-a2d8-09b7b2241c56]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:30:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:21 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 Sep 30 10:30:21 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:21 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" returned: 0 in 0.429s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.87a85830-b078-4704-867f-2dd1fafe0e10p4e5mrrs.img {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:21 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.87a85830-b078-4704-867f-2dd1fafe0e10p4e5mrrs.img Sep 30 10:30:21 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:24 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=65,cinder:SELECT=81,cinder:INSERT=26,cinder:DELETE=7 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:30:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c1286920-524b-42cd-b731-60240b2c129b req-453f915c-1e03-4113-b45a-2d0e9235f40f tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:30:30 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.87a85830-b078-4704-867f-2dd1fafe0e10p4e5mrrs.img" returned: 0 in 8.385s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:30 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9cc968-d766-4b96-b39a-2f216138b225]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:30:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:30 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 Sep 30 10:30:30 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:30 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" returned: 0 in 0.563s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:30 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9, size 1024.00 MB, duration 8.39 sec, destination /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.87a85830-b078-4704-867f-2dd1fafe0e10p4e5mrrs.img {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:30:30 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Converted 1024.00 MB image at 122.10 MB/s Sep 30 10:30:30 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] 87a85830-b078-4704-867f-2dd1fafe0e10 was raw, no need to convert to raw {{(pid=87013) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 30 10:30:36 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:30:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:30:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:30:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:30:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:30:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:30:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:30:37 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:30:37 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:30:37 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Sep 30 10:30:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.346s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:30:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:30:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:30:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 28 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:30:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:30:40 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=1 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:30:40 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=54,cinder:SELECT=78,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:31:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.530s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Uploaded volume to glance image-id: 87a85830-b078-4704-867f-2dd1fafe0e10. {{(pid=87013) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 30 10:31:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c1286920-524b-42cd-b731-60240b2c129b req-453f915c-1e03-4113-b45a-2d0e9235f40f tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 36.211s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c1286920-524b-42cd-b731-60240b2c129b req-453f915c-1e03-4113-b45a-2d0e9235f40f tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-25faa9ef-a011-4aa4-9e6c-b58c071f0a54 tempest-VolumesActionsTest-1191574243 None] Copy volume to image completed successfully. Sep 30 10:31:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-c1286920-524b-42cd-b731-60240b2c129b req-453f915c-1e03-4113-b45a-2d0e9235f40f tempest-ServerActionsTestOtherA-342232922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-44a9ca9a-e371-43ca-a9a7-1190523b8727', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7cf936b-6673-4e22-b9ee-adc53b793286', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:31:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-c1286920-524b-42cd-b731-60240b2c129b req-453f915c-1e03-4113-b45a-2d0e9235f40f tempest-ServerActionsTestOtherA-342232922 None] attachment_update completed successfully. Sep 30 10:31:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:03 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6ef556-1049-4431-8ee9-0438b1d938db]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:03 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 Sep 30 10:31:03 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:03 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" returned: 0 in 0.605s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:03 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e680c7-d82b-4c84-93b6-8c6c0ceead87]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:03 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 Sep 30 10:31:03 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:04 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" returned: 0 in 0.612s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:04 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img Sep 30 10:31:04 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Flow 'volume_create_manager' (17f4fe49-e45b-4d75-9358-03812d2ac5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f57dbe-67bf-4f5a-ba77-3da380669510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f57dbe-67bf-4f5a-ba77-3da380669510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-35109124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb12684-6772-41e6-af15-52aadbde848b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a18464bd6094392984c61f5b8812621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:07Z,use_quota=True,user_id='af30d8e8377e4b34b35b093e599a542f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab01baa8-5309-444e-af01-5192dc30c0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab01baa8-5309-444e-af01-5192dc30c0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386c6d3b-3cc3-41d3-981f-e1cba3b62d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386c6d3b-3cc3-41d3-981f-e1cba3b62d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb12684-6772-41e6-af15-52aadbde848b', 'volume_name': 'volume-dfb12684-6772-41e6-af15-52aadbde848b', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470659b8-b2b9-4560-9f48-3c985bb0200a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470659b8-b2b9-4560-9f48-3c985bb0200a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2229c09a-e1d2-4a07-9023-af9950f9d340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:07 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Volume dfb12684-6772-41e6-af15-52aadbde848b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb12684-6772-41e6-af15-52aadbde848b', 'volume_size': 1} Sep 30 10:31:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:17 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:31:17 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:31:17 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img" returned: 0 in 13.592s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:17 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da5b1ea-250a-46a3-8351-adb34e571e3e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:18 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 Sep 30 10:31:18 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:18 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" returned: 0 in 0.670s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:18 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9, size 1024.00 MB, duration 13.59 sec, destination /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:31:18 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Converted 1024.00 MB image at 75.33 MB/s Sep 30 10:31:18 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] 7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830 was raw, converting to qcow2 {{(pid=87013) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 30 10:31:18 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[773f52bd-445d-4bc6-a934-9cb443778441]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:18 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img Sep 30 10:31:18 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:18 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img" returned: 0 in 0.342s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:19 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img Sep 30 10:31:19 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:19 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img" returned: 1 in 0.500s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:31:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img /opt/stack/data/cinder/conversion/vol_upload_u1_nuon3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:19 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img /opt/stack/data/cinder/conversion/vol_upload_u1_nuon3 Sep 30 10:31:19 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:19 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img /opt/stack/data/cinder/conversion/vol_upload_u1_nuon3" returned: 0 in 0.366s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:19 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Image conversion details: src /opt/stack/data/cinder/conversion/ef767bc3-30d6-49f4-9ad6-67f9523e92d9.temp_image.7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830i8dl5w4q.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_u1_nuon3 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:31:19 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 30 10:31:19 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a92b47-5a19-4335-a4dd-86c47fc4554b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u1_nuon3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:19 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u1_nuon3 Sep 30 10:31:19 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:20 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u1_nuon3" returned: 0 in 0.363s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Flow 'volume_create_manager' (730bc754-7083-495e-8e6a-a28656251cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73c0d19-a45a-4752-b59d-0751894c5ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73c0d19-a45a-4752-b59d-0751894c5ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-539243364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66bfbd38-d051-471b-814e-b3752a3192f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb24ef7fc1f409bad211268745b845c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:21Z,use_quota=True,user_id='5ade312f611e4bd5ae72c78830cd6bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8622e79e-fd86-42f9-8535-13de025b971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8622e79e-fd86-42f9-8535-13de025b971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbed553a-2bd3-4fcb-b493-2ee8c8d5f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbed553a-2bd3-4fcb-b493-2ee8c8d5f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66bfbd38-d051-471b-814e-b3752a3192f2', 'volume_name': 'volume-66bfbd38-d051-471b-814e-b3752a3192f2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c9f1a0-65d5-4b9f-aeb4-c20ed8b8bb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c9f1a0-65d5-4b9f-aeb4-c20ed8b8bb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c80d4d3-dcf9-4ab8-886c-b23ca43b6525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:21 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Volume 66bfbd38-d051-471b-814e-b3752a3192f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66bfbd38-d051-471b-814e-b3752a3192f2', 'volume_size': 1} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 18.843s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Uploaded volume to glance image-id: 7d19cfae-d9d7-4fc3-b5c8-3ec8511c2830. {{(pid=87013) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.227s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-35109124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb12684-6772-41e6-af15-52aadbde848b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a18464bd6094392984c61f5b8812621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:07Z,use_quota=True,user_id='af30d8e8377e4b34b35b093e599a542f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Creating volume dfb12684-6772-41e6-af15-52aadbde848b {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:31:21 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:31:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:21 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-28e22ca3-890d-43e8-8877-6eb02abd945e tempest-VolumesActionsTest-1191574243 None] Copy volume to image completed successfully. Sep 30 10:31:21 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b 1073741824 Sep 30 10:31:21 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:22 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b 1073741824" returned: 0 in 0.508s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:22 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b Sep 30 10:31:22 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:22 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b" returned: 0 in 0.274s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-539243364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66bfbd38-d051-471b-814e-b3752a3192f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb24ef7fc1f409bad211268745b845c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:21Z,use_quota=True,user_id='5ade312f611e4bd5ae72c78830cd6bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Creating volume 66bfbd38-d051-471b-814e-b3752a3192f2 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:31:22 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:22 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2 1073741824 Sep 30 10:31:22 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2229c09a-e1d2-4a07-9023-af9950f9d340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb12684-6772-41e6-af15-52aadbde848b', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f51d81-a3d4-411a-8c5f-e75ebbdd103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:22 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Volume volume-dfb12684-6772-41e6-af15-52aadbde848b (dfb12684-6772-41e6-af15-52aadbde848b): created successfully Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f51d81-a3d4-411a-8c5f-e75ebbdd103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Flow 'volume_create_manager' (17f4fe49-e45b-4d75-9358-03812d2ac5f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:22 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2b60b376-25da-4f1c-b6b5-b0a338478e97 tempest-AttachVolumeNegativeTest-1648356732 None] Created volume successfully. Sep 30 10:31:23 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2 1073741824" returned: 0 in 0.562s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:23 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2 Sep 30 10:31:23 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Acquiring lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Acquiring lock "cinder-quobyte-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:23 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2" returned: 0 in 0.457s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Lock "cinder-quobyte-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" acquired by "delete_volume" :: waited 0.039s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c80d4d3-dcf9-4ab8-886c-b23ca43b6525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66bfbd38-d051-471b-814e-b3752a3192f2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7b6a0b-cf21-4d6f-9f13-f441a9f0e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb92b4a-017b-45ce-a00c-384cb88231b9]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:23 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Volume volume-66bfbd38-d051-471b-814e-b3752a3192f2 (66bfbd38-d051-471b-814e-b3752a3192f2): created successfully Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7b6a0b-cf21-4d6f-9f13-f441a9f0e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Flow 'volume_create_manager' (730bc754-7083-495e-8e6a-a28656251cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:23 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-86a7f8ae-66bc-48d8-84a6-dfe33e4021ab tempest-TestMinimumBasicScenario-8350338 None] Created volume successfully. Sep 30 10:31:24 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 Sep 30 10:31:24 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:24 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" returned: 0 in 0.553s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:24 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9 Sep 30 10:31:24 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c037e019-f924-48e2-81ae-7607029a9e1c req-d3557638-a6d9-405d-9d5f-c9402be117da tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c037e019-f924-48e2-81ae-7607029a9e1c req-d3557638-a6d9-405d-9d5f-c9402be117da tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c037e019-f924-48e2-81ae-7607029a9e1c req-d3557638-a6d9-405d-9d5f-c9402be117da tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-c037e019-f924-48e2-81ae-7607029a9e1c req-d3557638-a6d9-405d-9d5f-c9402be117da tempest-AttachVolumeNegativeTest-1648356732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-dfb12684-6772-41e6-af15-52aadbde848b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67ca6b35-3e63-4d2f-912b-27c1ab644299', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:31:24 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-c037e019-f924-48e2-81ae-7607029a9e1c req-d3557638-a6d9-405d-9d5f-c9402be117da tempest-AttachVolumeNegativeTest-1648356732 None] attachment_update completed successfully. Sep 30 10:31:25 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" returned: 0 in 0.581s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Lock "cinder-quobyte-ef767bc3-30d6-49f4-9ad6-67f9523e92d9" released by "delete_volume" :: held 1.201s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Created reservations ['b555480b-a881-476c-9c06-0ed16363750e', '97049729-1172-43e4-8aa4-57137d3429a7', 'e8faf599-a7e8-42ce-9690-c3bac6403511', '307eb69a-1d98-4175-85ca-e698316661c8'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:25 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:31:25 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:25 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.643s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:25 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:31:25 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Deleted volume successfully. Sep 30 10:31:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e0e61302-7a69-44f1-ac48-6ebaa77d95a9 tempest-VolumesActionsTest-1191574243 None] Lock "cinder-ef767bc3-30d6-49f4-9ad6-67f9523e92d9-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-a631558e-9755-4937-8cbd-b131654efcd7 req-dfc57d56-afca-44fa-ba74-d6fd8026b4f6 tempest-TestMinimumBasicScenario-8350338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-a631558e-9755-4937-8cbd-b131654efcd7 req-dfc57d56-afca-44fa-ba74-d6fd8026b4f6 tempest-TestMinimumBasicScenario-8350338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-a631558e-9755-4937-8cbd-b131654efcd7 req-dfc57d56-afca-44fa-ba74-d6fd8026b4f6 tempest-TestMinimumBasicScenario-8350338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-a631558e-9755-4937-8cbd-b131654efcd7 req-dfc57d56-afca-44fa-ba74-d6fd8026b4f6 tempest-TestMinimumBasicScenario-8350338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-66bfbd38-d051-471b-814e-b3752a3192f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '535d9d93-6fd6-4baa-b8d0-bed14f71470c', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:31:26 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-a631558e-9755-4937-8cbd-b131654efcd7 req-dfc57d56-afca-44fa-ba74-d6fd8026b4f6 tempest-TestMinimumBasicScenario-8350338 None] attachment_update completed successfully. Sep 30 10:31:28 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-d9c141f8-40b0-487f-85ef-5788e24432db req-88d93248-f644-4dfe-9339-40aac8b57801 tempest-AttachVolumeNegativeTest-1648356732 None] Terminate volume connection completed successfully. Sep 30 10:31:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d9c141f8-40b0-487f-85ef-5788e24432db req-88d93248-f644-4dfe-9339-40aac8b57801 tempest-AttachVolumeNegativeTest-1648356732 None] Deleting attachment 67ca6b35-3e63-4d2f-912b-27c1ab644299. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:31:36 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:37 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:31:37 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:37 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.376s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 28 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "cinder-dfb12684-6772-41e6-af15-52aadbde848b-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-dfb12684-6772-41e6-af15-52aadbde848b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "cinder-quobyte-dfb12684-6772-41e6-af15-52aadbde848b" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-quobyte-dfb12684-6772-41e6-af15-52aadbde848b" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[558c067e-36fe-4684-9ebe-f834999d0597]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:37 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b Sep 30 10:31:37 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:38 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b" returned: 0 in 0.529s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:38 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b Sep 30 10:31:38 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:38 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfb12684-6772-41e6-af15-52aadbde848b" returned: 0 in 0.474s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-quobyte-dfb12684-6772-41e6-af15-52aadbde848b" released by "delete_volume" :: held 1.102s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Created reservations ['fd5e4b0b-1cd6-498a-80a8-427e18504da8', 'bbdfc7f7-47b4-4961-b39f-edf7d0ec3282', 'aa59bece-ef1c-45d5-8da2-7150778d6894', '636d7e9a-ea0c-4501-80bf-8115add60b7b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:39 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:31:39 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:39 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.510s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:39 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:31:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Deleted volume successfully. Sep 30 10:31:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7ab724e8-0b71-4ba9-976e-d01e7ab4486b tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-dfb12684-6772-41e6-af15-52aadbde848b-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "cinder-d2ab3119-3625-4e85-8479-3b676b9e6f55-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-d2ab3119-3625-4e85-8479-3b676b9e6f55-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "cinder-quobyte-d2ab3119-3625-4e85-8479-3b676b9e6f55" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-quobyte-d2ab3119-3625-4e85-8479-3b676b9e6f55" acquired by "delete_volume" :: waited 0.042s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[08465977-a2ef-4fc0-bf42-69657f9c7b08]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Flow 'volume_create_manager' (a6eba4b7-405a-489c-aeb8-4fed0316755b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:40 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55 Sep 30 10:31:40 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7901ce40-a42a-4cee-8e3e-9527e728db7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7901ce40-a42a-4cee-8e3e-9527e728db7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-25886105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c55636-e08a-466c-9e65-d74d5b1c1199,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c3768f28e8048feafd4cff1641484bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:41Z,use_quota=True,user_id='181e70abd2804536b8d132bd846630ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d32800-23e2-48c3-8edc-33c138b0e0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d32800-23e2-48c3-8edc-33c138b0e0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a345c3-3fbb-433e-af25-8c13debb6aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a345c3-3fbb-433e-af25-8c13debb6aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c55636-e08a-466c-9e65-d74d5b1c1199', 'volume_name': 'volume-40c55636-e08a-466c-9e65-d74d5b1c1199', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a847ee99-51a6-4ff1-802a-16c95eb1a859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a847ee99-51a6-4ff1-802a-16c95eb1a859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5567fa0a-6172-4366-bf94-0a34dd229dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:40 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Volume 40c55636-e08a-466c-9e65-d74d5b1c1199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c55636-e08a-466c-9e65-d74d5b1c1199', 'volume_size': 1} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-25886105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c55636-e08a-466c-9e65-d74d5b1c1199,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c3768f28e8048feafd4cff1641484bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:41Z,use_quota=True,user_id='181e70abd2804536b8d132bd846630ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Creating volume 40c55636-e08a-466c-9e65-d74d5b1c1199 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:31:40 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:40 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199 1073741824 Sep 30 10:31:40 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:40 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55" returned: 0 in 0.489s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:41 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55 Sep 30 10:31:41 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:41 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-650f33f2-03d3-4244-800a-b505757f7a57 tempest-ServerActionsTestOtherA-342232922 None] Terminate volume connection completed successfully. Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-650f33f2-03d3-4244-800a-b505757f7a57 tempest-ServerActionsTestOtherA-342232922 None] Deleting attachment d7cf936b-6673-4e22-b9ee-adc53b793286. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "cinder-44a9ca9a-e371-43ca-a9a7-1190523b8727-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:41 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d2ab3119-3625-4e85-8479-3b676b9e6f55" returned: 0 in 0.453s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-quobyte-d2ab3119-3625-4e85-8479-3b676b9e6f55" released by "delete_volume" :: held 1.052s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:41 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199 1073741824" returned: 0 in 0.725s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Lock "cinder-44a9ca9a-e371-43ca-a9a7-1190523b8727-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "cinder-quobyte-44a9ca9a-e371-43ca-a9a7-1190523b8727" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Lock "cinder-quobyte-44a9ca9a-e371-43ca-a9a7-1190523b8727" acquired by "delete_volume" :: waited 0.061s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:41 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199 Sep 30 10:31:41 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Created reservations ['11a55840-77bf-4935-a637-3bb00691d1b9', '4064845c-7788-48f3-ab4b-5b9c25935b2a', '73efc7ac-0882-4d76-ab9c-89fdf573d52d', 'c636fe8b-5ebb-4ffd-8df5-c1fe999e6d3d'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2b9ab9-755a-408b-9e65-5b91a8063e72]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:41 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:31:41 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:41 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 Sep 30 10:31:41 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:41 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199" returned: 0 in 0.462s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:31:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5567fa0a-6172-4366-bf94-0a34dd229dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c55636-e08a-466c-9e65-d74d5b1c1199', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bb191d-5eab-46ad-b6bc-3da9614ff7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:42 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Volume volume-40c55636-e08a-466c-9e65-d74d5b1c1199 (40c55636-e08a-466c-9e65-d74d5b1c1199): created successfully Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bb191d-5eab-46ad-b6bc-3da9614ff7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Flow 'volume_create_manager' (a6eba4b7-405a-489c-aeb8-4fed0316755b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:42 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-581ca4fe-d021-475a-84e7-6b15ac4723b8 tempest-VolumesListTestJSON-1856541267 None] Created volume successfully. Sep 30 10:31:42 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.330s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:31:42 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Deleted volume successfully. Sep 30 10:31:42 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727" returned: 0 in 0.507s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f84e6c98-08c9-4ec6-947d-6f56723a6da5 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-d2ab3119-3625-4e85-8479-3b676b9e6f55-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:42 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727 Sep 30 10:31:42 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:42 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-44a9ca9a-e371-43ca-a9a7-1190523b8727" returned: 0 in 0.341s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Lock "cinder-quobyte-44a9ca9a-e371-43ca-a9a7-1190523b8727" released by "delete_volume" :: held 0.982s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG cinder.quota [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Created reservations ['031bebcc-cadd-4499-85ae-f2c5b37d8f95', 'e6cfc60e-ae8e-4577-ac80-949bb6b727fe', '45a0091e-e8b7-425d-92ec-03bb8c6cb55d', 'af34b59d-611b-42f5-8a25-81ab41bad37f'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:42 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:31:42 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:43 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.344s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.manager [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "cinder-e897334f-84a2-4473-8f19-c126eced432f-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Deleted volume successfully. Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-2c45bb15-0ccb-4bf2-92aa-297bfd77812d req-e88dc51c-e1cf-4647-9729-fc8df12dc428 tempest-ServerActionsTestOtherA-342232922 None] Lock "cinder-44a9ca9a-e371-43ca-a9a7-1190523b8727-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-e897334f-84a2-4473-8f19-c126eced432f-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "cinder-quobyte-e897334f-84a2-4473-8f19-c126eced432f" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-quobyte-e897334f-84a2-4473-8f19-c126eced432f" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d47712-1f47-4b90-884a-5d8a70783b57]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "cinder-a1638887-b4cc-4c34-b2ae-69baef091652-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Lock "cinder-a1638887-b4cc-4c34-b2ae-69baef091652-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "cinder-quobyte-a1638887-b4cc-4c34-b2ae-69baef091652" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Lock "cinder-quobyte-a1638887-b4cc-4c34-b2ae-69baef091652" acquired by "delete_volume" :: waited 0.039s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:43 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f Sep 30 10:31:43 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Flow 'volume_create_manager' (5fecefbd-61ff-41e4-8b83-54ddc25aa6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e91f89-1dd6-44a2-9faa-19f1880a2500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[11107450-b3c6-4355-af0a-4b7db54638b5]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e91f89-1dd6-44a2-9faa-19f1880a2500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1777473977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d6ab7e-7fd1-4050-b92f-35de1e614e7c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c3768f28e8048feafd4cff1641484bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:44Z,use_quota=True,user_id='181e70abd2804536b8d132bd846630ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c63144-6dc3-46cb-baac-fb0cfe828fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c63144-6dc3-46cb-baac-fb0cfe828fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea26f8b0-8b76-4e50-9e95-8812436bc084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea26f8b0-8b76-4e50-9e95-8812436bc084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d6ab7e-7fd1-4050-b92f-35de1e614e7c', 'volume_name': 'volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406b91b4-1114-4017-8714-eb738d6b35ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406b91b4-1114-4017-8714-eb738d6b35ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7625009-f5f0-4273-af6e-7de69b39685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:43 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Volume b4d6ab7e-7fd1-4050-b92f-35de1e614e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c', 'volume_size': 1} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1777473977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d6ab7e-7fd1-4050-b92f-35de1e614e7c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c3768f28e8048feafd4cff1641484bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:44Z,use_quota=True,user_id='181e70abd2804536b8d132bd846630ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Creating volume b4d6ab7e-7fd1-4050-b92f-35de1e614e7c {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:31:43 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:43 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c 1073741824 Sep 30 10:31:43 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:43 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652 Sep 30 10:31:43 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:43 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f" returned: 0 in 0.509s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:43 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f Sep 30 10:31:43 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:44 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652" returned: 0 in 0.450s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:44 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652 Sep 30 10:31:44 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:44 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e897334f-84a2-4473-8f19-c126eced432f" returned: 0 in 0.330s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:44 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-quobyte-e897334f-84a2-4473-8f19-c126eced432f" released by "delete_volume" :: held 0.912s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c 1073741824" returned: 0 in 0.549s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:44 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Created reservations ['4845830e-a78a-49ec-8fae-c970d3c4eb1f', '4bcbb533-31b0-4381-86f2-2fe9c326558c', '16123683-8ad3-463d-979e-1682af1f56f8', '50e0d6bb-8016-45b8-a1ad-db07e5602cfd'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:31:44 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:44 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a1638887-b4cc-4c34-b2ae-69baef091652" returned: 0 in 0.317s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Lock "cinder-quobyte-a1638887-b4cc-4c34-b2ae-69baef091652" released by "delete_volume" :: held 0.861s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:44 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:31:44 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Created reservations ['c4139ee9-0abe-4046-bdea-25fa7956e878', 'b4f2ad95-3059-4b03-8939-8717f2871582', '4172f7e3-dd04-483e-a5a6-91a7f049a21d', '431635c7-24ed-4f17-9e71-fcf32c6a15be'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:44 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:31:44 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:44 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c" returned: 0 in 0.352s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7625009-f5f0-4273-af6e-7de69b39685c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3480bce5-2e94-4af2-b5a0-ae82215bcdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:44 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Volume volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c (b4d6ab7e-7fd1-4050-b92f-35de1e614e7c): created successfully Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3480bce5-2e94-4af2-b5a0-ae82215bcdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Flow 'volume_create_manager' (5fecefbd-61ff-41e4-8b83-54ddc25aa6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-baf2cfc1-7f6b-4b64-ba18-5351030b13ab tempest-VolumesListTestJSON-1856541267 None] Created volume successfully. Sep 30 10:31:44 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.283s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:31:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Deleted volume successfully. Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ae1fe3de-7b17-441c-b55e-638d96fcefc6 tempest-AttachVolumeNegativeTest-1648356732 None] Lock "cinder-e897334f-84a2-4473-8f19-c126eced432f-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:44 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.260s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:31:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Deleted volume successfully. Sep 30 10:31:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-39f21107-521c-4c9d-b18c-09ae40ee07ca tempest-ServerActionsTestOtherA-342232922 None] Lock "cinder-a1638887-b4cc-4c34-b2ae-69baef091652-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Flow 'volume_create_manager' (95d4e870-6a33-4e43-a72c-991733afbd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87abe58-6ddf-4c94-a527-704c71888913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87abe58-6ddf-4c94-a527-704c71888913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-972453680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b335a61d-749a-413e-976c-e9212fb5d2c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c3768f28e8048feafd4cff1641484bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:46Z,use_quota=True,user_id='181e70abd2804536b8d132bd846630ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45424a8b-6f14-4a72-acdd-bd1b58bf7398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45424a8b-6f14-4a72-acdd-bd1b58bf7398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5682de68-c9a5-4c0c-ba69-4c1139cc3423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5682de68-c9a5-4c0c-ba69-4c1139cc3423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b335a61d-749a-413e-976c-e9212fb5d2c3', 'volume_name': 'volume-b335a61d-749a-413e-976c-e9212fb5d2c3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f31d2cf-3c35-4b2c-9bdf-8e7343671c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f31d2cf-3c35-4b2c-9bdf-8e7343671c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f766c4cb-54d8-4393-bac9-ee456866618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:46 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Volume b335a61d-749a-413e-976c-e9212fb5d2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b335a61d-749a-413e-976c-e9212fb5d2c3', 'volume_size': 1} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-972453680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b335a61d-749a-413e-976c-e9212fb5d2c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c3768f28e8048feafd4cff1641484bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:46Z,use_quota=True,user_id='181e70abd2804536b8d132bd846630ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Creating volume b335a61d-749a-413e-976c-e9212fb5d2c3 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:31:46 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:31:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:46 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3 1073741824 Sep 30 10:31:46 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:47 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3 1073741824" returned: 0 in 0.760s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:47 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3 Sep 30 10:31:47 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:47 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3" returned: 0 in 0.342s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:31:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f766c4cb-54d8-4393-bac9-ee456866618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b335a61d-749a-413e-976c-e9212fb5d2c3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957f6d53-8a99-4e83-aeef-4188d90295bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:47 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Volume volume-b335a61d-749a-413e-976c-e9212fb5d2c3 (b335a61d-749a-413e-976c-e9212fb5d2c3): created successfully Sep 30 10:31:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957f6d53-8a99-4e83-aeef-4188d90295bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Flow 'volume_create_manager' (95d4e870-6a33-4e43-a72c-991733afbd0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:47 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8bf37010-3cb1-46a3-992e-c8c1904e78ca tempest-VolumesListTestJSON-1856541267 None] Created volume successfully. Sep 30 10:31:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "cinder-b335a61d-749a-413e-976c-e9212fb5d2c3-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-b335a61d-749a-413e-976c-e9212fb5d2c3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "cinder-quobyte-b335a61d-749a-413e-976c-e9212fb5d2c3" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-quobyte-b335a61d-749a-413e-976c-e9212fb5d2c3" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:51 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bd13a2-35c2-4d99-b2f4-285e895e4c7d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:51 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3 Sep 30 10:31:51 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:52 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3" returned: 0 in 0.669s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:52 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3 Sep 30 10:31:52 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:52 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b335a61d-749a-413e-976c-e9212fb5d2c3" returned: 0 in 0.335s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-quobyte-b335a61d-749a-413e-976c-e9212fb5d2c3" released by "delete_volume" :: held 1.097s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Created reservations ['a7087604-017a-49d6-964c-503030c3683a', '330e8be6-113c-4619-a867-af51bda08b29', '3db31ee1-d029-49c2-8d60-649ff22541a5', 'e326956f-02a3-4903-acbd-68c8180f722f'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:52 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:31:52 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:53 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.332s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:53 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:31:53 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Deleted volume successfully. Sep 30 10:31:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-578ff520-d441-4073-a495-08de967166d4 tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-b335a61d-749a-413e-976c-e9212fb5d2c3-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "cinder-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "cinder-quobyte-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-quobyte-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[637bca82-d88d-4a40-b6d1-ff6ce8a87b9d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:54 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c Sep 30 10:31:54 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:54 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c" returned: 0 in 0.478s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:54 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c Sep 30 10:31:54 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:54 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c" returned: 0 in 0.369s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-quobyte-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c" released by "delete_volume" :: held 0.963s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Created reservations ['c4c4abef-3908-4eab-ac38-b32edcf09a6b', '2df42234-beaf-44db-826c-f926487895a8', 'ebe282b8-e4d4-402c-8f54-ec16150dd29e', 'b83ac8c0-526a-44c6-94b4-910c18859b32'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:31:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:55 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:31:55 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:55 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.272s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:55 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:31:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Deleted volume successfully. Sep 30 10:31:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-380122c7-eff2-42a1-a018-ba999d1356fa tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-b4d6ab7e-7fd1-4050-b92f-35de1e614e7c-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "cinder-40c55636-e08a-466c-9e65-d74d5b1c1199-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-40c55636-e08a-466c-9e65-d74d5b1c1199-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "cinder-quobyte-40c55636-e08a-466c-9e65-d74d5b1c1199" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-quobyte-40c55636-e08a-466c-9e65-d74d5b1c1199" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1a0c6-dd66-4663-a848-dc772fd9c3d5]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:56 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199 Sep 30 10:31:56 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Flow 'volume_create_manager' (f05fad2b-1ea6-44aa-910c-236ef6629726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c37816-72b2-444b-b47e-18b6d8a2e883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c37816-72b2-444b-b47e-18b6d8a2e883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-723665486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb3e91c-5d86-4f95-9b04-da5531d2ee68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb64c7d1a7348a48b8c6ece49042f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:57Z,use_quota=True,user_id='63839449649f48e88168ab8b9f4fde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64379526-32de-4c08-b746-f754b3620926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64379526-32de-4c08-b746-f754b3620926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a776579-0106-4dec-91f8-ed8b20422b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a776579-0106-4dec-91f8-ed8b20422b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb3e91c-5d86-4f95-9b04-da5531d2ee68', 'volume_name': 'volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7196b9dd-c3c4-44e2-ae96-fa2f33cc3107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7196b9dd-c3c4-44e2-ae96-fa2f33cc3107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0d1240-3f81-4e08-a4df-4d01da7e266a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:56 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Volume 9eb3e91c-5d86-4f95-9b04-da5531d2ee68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68', 'volume_size': 1} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-723665486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb3e91c-5d86-4f95-9b04-da5531d2ee68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb64c7d1a7348a48b8c6ece49042f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:57Z,use_quota=True,user_id='63839449649f48e88168ab8b9f4fde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Creating volume 9eb3e91c-5d86-4f95-9b04-da5531d2ee68 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:31:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:31:57 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:57 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68 1073741824 Sep 30 10:31:57 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:57 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199" returned: 0 in 0.629s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:57 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199 Sep 30 10:31:57 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:57 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40c55636-e08a-466c-9e65-d74d5b1c1199" returned: 0 in 0.338s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-quobyte-40c55636-e08a-466c-9e65-d74d5b1c1199" released by "delete_volume" :: held 1.064s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Created reservations ['f0720ce6-f5eb-4f88-8c6c-c3800d8f5e4f', '09425f80-c319-4fb3-9a7a-d7e121df5fda', 'f7e6cff3-b898-47b5-9e97-6e75cd1cc44b', 'c4b84f26-6244-4c4e-b00d-ec7fc9f93766'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:31:57 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68 1073741824" returned: 0 in 0.601s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:57 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68 Sep 30 10:31:57 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:57 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:31:57 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:31:57 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68" returned: 0 in 0.281s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0d1240-3f81-4e08-a4df-4d01da7e266a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5abb3b-06f7-45aa-9daa-97cb20d83187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:58 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Volume volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68 (9eb3e91c-5d86-4f95-9b04-da5531d2ee68): created successfully Sep 30 10:31:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5abb3b-06f7-45aa-9daa-97cb20d83187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Flow 'volume_create_manager' (f05fad2b-1ea6-44aa-910c-236ef6629726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-361827c9-c7d4-419e-ad5d-5fe9bdb2103a tempest-VolumesTestJSON-1509817400 None] Created volume successfully. Sep 30 10:31:58 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 30 10:31:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.336s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:31:58 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:31:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Deleted volume successfully. Sep 30 10:31:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c3333ef5-81a7-499a-a633-c836b105083c tempest-VolumesListTestJSON-1856541267 None] Lock "cinder-40c55636-e08a-466c-9e65-d74d5b1c1199-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Flow 'volume_create_manager' (accbf82b-abf8-4ee5-a5c3-c884414e4c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e23414-5ad3-49cb-8ab9-ca5c2f228d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e23414-5ad3-49cb-8ab9-ca5c2f228d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1704656259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd7a000-338c-4c07-b891-1a98807d7117,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb64c7d1a7348a48b8c6ece49042f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:59Z,use_quota=True,user_id='63839449649f48e88168ab8b9f4fde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b447f2-c40b-4feb-822f-0d0dae80133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b447f2-c40b-4feb-822f-0d0dae80133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6db532a-1400-48f9-98a7-ca49ef2cfa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6db532a-1400-48f9-98a7-ca49ef2cfa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd7a000-338c-4c07-b891-1a98807d7117', 'volume_name': 'volume-9bd7a000-338c-4c07-b891-1a98807d7117', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3f25d0-0725-4472-9322-fd2cfd031171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3f25d0-0725-4472-9322-fd2cfd031171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8c85c0-5bc1-4952-a70b-627b943116fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:31:59 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Volume 9bd7a000-338c-4c07-b891-1a98807d7117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd7a000-338c-4c07-b891-1a98807d7117', 'volume_size': 1} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1704656259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd7a000-338c-4c07-b891-1a98807d7117,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb64c7d1a7348a48b8c6ece49042f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:31:59Z,use_quota=True,user_id='63839449649f48e88168ab8b9f4fde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Creating volume 9bd7a000-338c-4c07-b891-1a98807d7117 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:31:59 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:31:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:31:59 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117 1073741824 Sep 30 10:31:59 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:00 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117 1073741824" returned: 0 in 0.730s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:00 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117 Sep 30 10:32:00 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:00 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117" returned: 0 in 0.346s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:32:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8c85c0-5bc1-4952-a70b-627b943116fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd7a000-338c-4c07-b891-1a98807d7117', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e9c0cd-b04b-4d96-80b6-9a9178dc7624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:00 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Volume volume-9bd7a000-338c-4c07-b891-1a98807d7117 (9bd7a000-338c-4c07-b891-1a98807d7117): created successfully Sep 30 10:32:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e9c0cd-b04b-4d96-80b6-9a9178dc7624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Flow 'volume_create_manager' (accbf82b-abf8-4ee5-a5c3-c884414e4c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:32:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7aab3875-d8bf-419f-9d04-bcfa197c0983 tempest-VolumesTestJSON-1509817400 None] Created volume successfully. Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Flow 'volume_create_manager' (d9b5e2c2-cc7d-4be2-98c6-f938d0c30871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbc1d5e-565e-4c37-b97f-3e550bba069b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbc1d5e-565e-4c37-b97f-3e550bba069b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1639781171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91c3b79-e0d8-463e-b4b1-2a71151e244c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb64c7d1a7348a48b8c6ece49042f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:32:02Z,use_quota=True,user_id='63839449649f48e88168ab8b9f4fde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a69c10a-1919-46de-aabb-d7d37e7afd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a69c10a-1919-46de-aabb-d7d37e7afd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e88b76-1aa5-4b54-b378-b2bfd08331f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e88b76-1aa5-4b54-b378-b2bfd08331f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91c3b79-e0d8-463e-b4b1-2a71151e244c', 'volume_name': 'volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f30bed9-169f-4f2b-a2de-1ced509294fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f30bed9-169f-4f2b-a2de-1ced509294fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e240318d-29d4-4702-8fed-2ace65a083e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:02 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Volume a91c3b79-e0d8-463e-b4b1-2a71151e244c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c', 'volume_size': 1} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1639781171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91c3b79-e0d8-463e-b4b1-2a71151e244c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb64c7d1a7348a48b8c6ece49042f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:32:02Z,use_quota=True,user_id='63839449649f48e88168ab8b9f4fde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Creating volume a91c3b79-e0d8-463e-b4b1-2a71151e244c {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:32:02 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:32:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:02 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c 1073741824 Sep 30 10:32:02 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:03 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c 1073741824" returned: 0 in 0.706s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:03 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c Sep 30 10:32:03 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:03 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c" returned: 0 in 0.287s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:32:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e240318d-29d4-4702-8fed-2ace65a083e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dcb8da-ef0e-4414-b0a3-fb3b9a8709bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:03 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Volume volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c (a91c3b79-e0d8-463e-b4b1-2a71151e244c): created successfully Sep 30 10:32:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dcb8da-ef0e-4414-b0a3-fb3b9a8709bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Flow 'volume_create_manager' (d9b5e2c2-cc7d-4be2-98c6-f938d0c30871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:32:03 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f86a068c-c86a-4918-8112-41a9fb57444e tempest-VolumesTestJSON-1509817400 None] Created volume successfully. Sep 30 10:32:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Acquiring lock "cinder-a91c3b79-e0d8-463e-b4b1-2a71151e244c-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Lock "cinder-a91c3b79-e0d8-463e-b4b1-2a71151e244c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Acquiring lock "cinder-quobyte-a91c3b79-e0d8-463e-b4b1-2a71151e244c" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Lock "cinder-quobyte-a91c3b79-e0d8-463e-b4b1-2a71151e244c" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:06 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9e5587-900e-459c-bbb3-76407078db67]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:32:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:06 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c Sep 30 10:32:06 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:06 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c" returned: 0 in 0.449s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:06 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c Sep 30 10:32:06 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:06 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a91c3b79-e0d8-463e-b4b1-2a71151e244c" returned: 0 in 0.378s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Lock "cinder-quobyte-a91c3b79-e0d8-463e-b4b1-2a71151e244c" released by "delete_volume" :: held 0.908s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:06 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Created reservations ['7bd4f30b-ccb8-43fe-8c74-605b64943748', '191f042f-0846-4737-b8ca-88d04187179c', '757f56fd-5c23-4194-8b28-1271a8410d10', '9f4cee64-aaa1-45aa-a21a-9733a17db6f2'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:07 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:32:07 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Acquiring lock "cinder-9bd7a000-338c-4c07-b891-1a98807d7117-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Lock "cinder-9bd7a000-338c-4c07-b891-1a98807d7117-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Acquiring lock "cinder-quobyte-9bd7a000-338c-4c07-b891-1a98807d7117" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Lock "cinder-quobyte-9bd7a000-338c-4c07-b891-1a98807d7117" acquired by "delete_volume" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[997bc018-c54d-4781-8e36-4c5405b71a21]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:07 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117 Sep 30 10:32:07 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:07 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.405s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:32:07 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Deleted volume successfully. Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8b5cf486-3b0d-4d6c-921b-08bdcecd8052 tempest-VolumesTestJSON-1509817400 None] Lock "cinder-a91c3b79-e0d8-463e-b4b1-2a71151e244c-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:07 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117" returned: 0 in 0.435s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:07 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117 Sep 30 10:32:07 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:08 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9bd7a000-338c-4c07-b891-1a98807d7117" returned: 0 in 0.296s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Lock "cinder-quobyte-9bd7a000-338c-4c07-b891-1a98807d7117" released by "delete_volume" :: held 0.793s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Created reservations ['65a4edb8-ee0f-40b8-bac3-c53824a26b1b', '132938d1-1350-4655-ad2f-fd4b26e53dba', '6587005d-d5d9-42ed-85e5-c4ef71e6438d', '6052c5cc-7d20-4c0a-83d2-40be68f65bf2'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:08 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:32:08 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Acquiring lock "cinder-9eb3e91c-5d86-4f95-9b04-da5531d2ee68-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Lock "cinder-9eb3e91c-5d86-4f95-9b04-da5531d2ee68-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Acquiring lock "cinder-quobyte-9eb3e91c-5d86-4f95-9b04-da5531d2ee68" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Lock "cinder-quobyte-9eb3e91c-5d86-4f95-9b04-da5531d2ee68" acquired by "delete_volume" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba05dae-d518-4ba4-a317-3358086e4d32]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:08 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.426s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:32:08 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Deleted volume successfully. Sep 30 10:32:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5a4a8b7-99c7-4965-b389-c2eb0a93ec4a tempest-VolumesTestJSON-1509817400 None] Lock "cinder-9bd7a000-338c-4c07-b891-1a98807d7117-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:08 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68 Sep 30 10:32:08 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:09 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68" returned: 0 in 0.533s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:09 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68 Sep 30 10:32:09 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:09 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9eb3e91c-5d86-4f95-9b04-da5531d2ee68" returned: 0 in 0.283s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Lock "cinder-quobyte-9eb3e91c-5d86-4f95-9b04-da5531d2ee68" released by "delete_volume" :: held 0.895s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Created reservations ['39c5f13d-c7d7-446e-b35f-acad3a2889e4', '61d25910-9fb5-4bc9-b123-536fa2af6cbf', '9bb3e02b-9c87-4208-9c05-c5f0f25576d0', '189a2ba5-fb79-41b8-96c4-3d22302bfaa0'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:09 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:32:09 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:10 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.366s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:10 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:32:10 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Deleted volume successfully. Sep 30 10:32:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-93baf9ad-6bee-4857-aec2-7756065df298 tempest-VolumesTestJSON-1509817400 None] Lock "cinder-9eb3e91c-5d86-4f95-9b04-da5531d2ee68-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26004c82-386e-495d-bf68-91664f8f9d0b tempest-BackendsCapabilitiesAdminTestsJSON-1447931201 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.958896636963, 'free_capacity_gb': 1774.958896636963, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87013) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 30 10:32:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-08cd8f38-023d-47ec-90c4-b4f34721d648 tempest-BackendsCapabilitiesAdminTestsJSON-1447931201 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.958896636963, 'free_capacity_gb': 1774.958896636963, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87013) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 30 10:32:19 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=86,cinder:UPDATE=126,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:32:20 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=97,cinder:UPDATE=120,cinder:DELETE=10,cinder:INSERT=28 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:32:25 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-fcf7fdc8-f790-4d47-be0b-20e520eb0211 req-e9a2901e-23e5-4922-95d6-1c21170ef0ea tempest-TestMinimumBasicScenario-8350338 None] Terminate volume connection completed successfully. Sep 30 10:32:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-fcf7fdc8-f790-4d47-be0b-20e520eb0211 req-e9a2901e-23e5-4922-95d6-1c21170ef0ea tempest-TestMinimumBasicScenario-8350338 None] Deleting attachment 535d9d93-6fd6-4baa-b8d0-bed14f71470c. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:32:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Acquiring lock "cinder-66bfbd38-d051-471b-814e-b3752a3192f2-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Lock "cinder-66bfbd38-d051-471b-814e-b3752a3192f2-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Acquiring lock "cinder-quobyte-66bfbd38-d051-471b-814e-b3752a3192f2" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Lock "cinder-quobyte-66bfbd38-d051-471b-814e-b3752a3192f2" acquired by "delete_volume" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:26 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8e55dd-a599-4fcc-ae48-bf7cfb005c9e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:32:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:26 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2 Sep 30 10:32:26 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:27 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2" returned: 0 in 0.730s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:27 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2 Sep 30 10:32:27 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:27 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-66bfbd38-d051-471b-814e-b3752a3192f2" returned: 0 in 0.603s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Lock "cinder-quobyte-66bfbd38-d051-471b-814e-b3752a3192f2" released by "delete_volume" :: held 1.505s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Created reservations ['4db49b12-36b9-485a-8618-0d493c2d4315', 'cea0764a-8ada-44eb-a100-63ca90bd4620', '0d3597db-51d9-452f-8dda-b8b71b2173e4', 'ebc9739d-5660-49aa-9533-d707b2090a48'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:28 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:32:28 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:28 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.754s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:28 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:32:28 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Deleted volume successfully. Sep 30 10:32:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-585a43b4-a658-43e5-bcc7-7948abdc4e4e tempest-TestMinimumBasicScenario-8350338 None] Lock "cinder-66bfbd38-d051-471b-814e-b3752a3192f2-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3c1c0a1b-20b6-4f53-9be6-512eaa3b8d26 tempest-GroupSnapshotsV319Test-2042435062 None] Group tempest-GroupSnapshotsV319Test-Group-204729945: creating Sep 30 10:32:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3c1c0a1b-20b6-4f53-9be6-512eaa3b8d26 tempest-GroupSnapshotsV319Test-2042435062 None] Group tempest-GroupSnapshotsV319Test-Group-204729945: created successfully Sep 30 10:32:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3c1c0a1b-20b6-4f53-9be6-512eaa3b8d26 tempest-GroupSnapshotsV319Test-2042435062 None] Create group completed successfully. Sep 30 10:32:34 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:32:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Flow 'volume_create_manager' (5d9d321b-266a-4ff1-9c6f-ad1d02334420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:32:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f29e7f5-228d-4f51-ae76-5df21536e314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f29e7f5-228d-4f51-ae76-5df21536e314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1232501805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b03d7a1b-cd99-427e-9e5b-d565d5f9e9dd,host='devstack@QuobyteHD#QuobyteHD',id=d3b8ae74-f891-41d7-a57f-a2734a2625ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db8fd4f9e79c42fca5887982dfe588d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:32:35Z,use_quota=True,user_id='c8ed44da6f4f43d78d564c5a53c0a811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b439302e-84d9-452a-ae14-704f4406483f),volume_type_id=b439302e-84d9-452a-ae14-704f4406483f)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3f9edf-8574-4ee8-a58a-7e5f81aab3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3f9edf-8574-4ee8-a58a-7e5f81aab3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd062ad-e6e9-4953-b893-4b2ffb291ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd062ad-e6e9-4953-b893-4b2ffb291ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b8ae74-f891-41d7-a57f-a2734a2625ce', 'volume_name': 'volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4bf282-3b56-4d55-ac83-d75087b382d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4bf282-3b56-4d55-ac83-d75087b382d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1a1b97-cfb2-4064-ba08-32854e418208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:35 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Volume d3b8ae74-f891-41d7-a57f-a2734a2625ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce', 'volume_size': 1} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b03d7a1b-cd99-427e-9e5b-d565d5f9e9dd,created_at=2026-09-30T08:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1232501805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b03d7a1b-cd99-427e-9e5b-d565d5f9e9dd,host='devstack@QuobyteHD#QuobyteHD',id=d3b8ae74-f891-41d7-a57f-a2734a2625ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db8fd4f9e79c42fca5887982dfe588d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:32:35Z,use_quota=True,user_id='c8ed44da6f4f43d78d564c5a53c0a811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b439302e-84d9-452a-ae14-704f4406483f),volume_type_id=b439302e-84d9-452a-ae14-704f4406483f)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Creating volume d3b8ae74-f891-41d7-a57f-a2734a2625ce {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:32:35 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:32:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:35 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce 1073741824 Sep 30 10:32:35 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:36 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce 1073741824" returned: 0 in 1.173s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:36 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce Sep 30 10:32:36 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:37 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:32:37 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:37 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce" returned: 0 in 0.823s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1a1b97-cfb2-4064-ba08-32854e418208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1372696b-aa58-4d57-902d-f9148585e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:37 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Volume volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce (d3b8ae74-f891-41d7-a57f-a2734a2625ce): created successfully Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1372696b-aa58-4d57-902d-f9148585e393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Flow 'volume_create_manager' (5d9d321b-266a-4ff1-9c6f-ad1d02334420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:32:37 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-12450895-c868-4ba2-95ac-892aa72669d9 tempest-GroupSnapshotsV319Test-2042435062 None] Created volume successfully. Sep 30 10:32:37 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.631s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 28 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:32:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:32:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] GroupSnapshot af552637-7d79-4edf-bcc3-6d50b9099653: creating. Sep 30 10:32:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Group snapshot af552637-7d79-4edf-bcc3-6d50b9099653: creating. {{(pid=87013) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 10:32:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Creating offline snapshot 722d9fbb-64cb-4bf2-9a66-f9b3a3724322 of volume d3b8ae74-f891-41d7-a57f-a2734a2625ce {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:32:39 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df4280a-ec77-4913-82d4-1bf70b77a62b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:32:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:39 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce Sep 30 10:32:39 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:39 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce" returned: 0 in 0.753s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:39 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 1G Sep 30 10:32:39 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:41 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 1G" returned: 0 in 1.167s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:41 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 Sep 30 10:32:41 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:41 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322" returned: 0 in 0.595s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:41 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:32:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:41 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 Sep 30 10:32:41 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:42 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322" returned: 0 in 0.754s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:42 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.info Sep 30 10:32:42 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:42 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.info" returned: 0 in 0.413s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:42 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 10:32:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:42 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.info Sep 30 10:32:42 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:43 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.info" returned: 0 in 0.468s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.400s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-38a0d85e-a02f-403d-9b74-d046a84f0437 tempest-GroupSnapshotsV319Test-2042435062 None] group_snapshot af552637-7d79-4edf-bcc3-6d50b9099653: created successfully Sep 30 10:32:45 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] group_snapshot af552637-7d79-4edf-bcc3-6d50b9099653: deleting Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] group_snapshot af552637-7d79-4edf-bcc3-6d50b9099653: deleting {{(pid=87013) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Acquiring lock "cinder-quobyte-d3b8ae74-f891-41d7-a57f-a2734a2625ce" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "cinder-quobyte-d3b8ae74-f891-41d7-a57f-a2734a2625ce" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Acquiring lock "cinder-quobyte-722d9fbb-64cb-4bf2-9a66-f9b3a3724322" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "cinder-quobyte-722d9fbb-64cb-4bf2-9a66-f9b3a3724322" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Deleting offline snapshot 722d9fbb-64cb-4bf2-9a66-f9b3a3724322 of volume d3b8ae74-f891-41d7-a57f-a2734a2625ce {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] snapshot_file for this snap is: volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8bacb3-a254-4c0b-9568-ea5b992dcc58]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:45 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 Sep 30 10:32:45 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:45 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322" returned: 0 in 0.548s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d40846e-2bc5-4b03-b48c-ecd0cc19a4b9]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:32:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:46 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce Sep 30 10:32:46 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:46 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce" returned: 0 in 0.561s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:46 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 Sep 30 10:32:46 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:47 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322" returned: 0 in 0.582s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:47 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322 Sep 30 10:32:47 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:47 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce.722d9fbb-64cb-4bf2-9a66-f9b3a3724322" returned: 0 in 0.374s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "cinder-quobyte-722d9fbb-64cb-4bf2-9a66-f9b3a3724322" released by "_delete_snapshot" :: held 2.273s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "cinder-quobyte-d3b8ae74-f891-41d7-a57f-a2734a2625ce" released by "delete_snapshot" :: held 2.320s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:47 devstack cinder-volume[87013]: WARNING cinder.quota [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1936662954 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1936662954, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:32:47 devstack cinder-volume[87013]: WARNING cinder.quota [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1936662954 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1936662954, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:32:47 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] Created reservations ['d2839f97-3f28-4785-a24e-597439dd897a', 'ae0e2a0e-9a57-4365-8e16-a9868ad2c12c', 'c7cffbce-f52d-473f-86a0-909a798a7338', '8c596529-2e0c-4546-8ef3-1f93debef5bc'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:32:47 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7dfad0ae-184c-4bee-b103-d14bb0574e61 tempest-GroupSnapshotsV319Test-2042435062 None] group_snapshot af552637-7d79-4edf-bcc3-6d50b9099653: deleted successfully Sep 30 10:32:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Acquiring lock "cinder-quobyte-d3b8ae74-f891-41d7-a57f-a2734a2625ce" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:32:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "cinder-quobyte-d3b8ae74-f891-41d7-a57f-a2734a2625ce" acquired by "delete_volume" :: waited 0.052s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:32:49 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[df76ca3d-69f0-4baa-92c5-e55d524c9c6c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:32:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:49 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce Sep 30 10:32:49 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:50 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce" returned: 0 in 0.824s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:50 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce Sep 30 10:32:50 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:50 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d3b8ae74-f891-41d7-a57f-a2734a2625ce" returned: 0 in 0.676s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "cinder-quobyte-d3b8ae74-f891-41d7-a57f-a2734a2625ce" released by "delete_volume" :: held 1.746s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Created reservations ['4299f950-2690-4fc9-ba93-149ab227062c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Flow 'volume_create_manager' (922af3e5-2646-4285-8aa5-d3bb1ede3a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da495507-8741-4eeb-b8f0-dc89276851b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da495507-8741-4eeb-b8f0-dc89276851b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-455322704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5a6fb5951642dc9f79ecef7cf35684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:32:51Z,use_quota=True,user_id='f808f98970b44b56bdab9114045235c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614ece0b-142b-4b67-8cad-786e9744068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614ece0b-142b-4b67-8cad-786e9744068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9141b4-b001-43af-b207-4aee082239b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9141b4-b001-43af-b207-4aee082239b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3', 'volume_name': 'volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19540996-65ba-47c3-adb4-887a562f216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19540996-65ba-47c3-adb4-887a562f216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1036c0a-7d4d-44cf-addb-0fcf642a49f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:51 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Volume e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3', 'volume_size': 1} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-455322704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5a6fb5951642dc9f79ecef7cf35684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:32:51Z,use_quota=True,user_id='f808f98970b44b56bdab9114045235c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Creating volume e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:32:51 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:51 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 1073741824 Sep 30 10:32:51 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:51 devstack cinder-volume[87013]: WARNING cinder.quota [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1936662954 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1936662954, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Created reservations ['4667a67e-f4a9-4a5f-ab3a-c21ac8f66348', 'bbe404b6-f0a9-4abe-a2de-8f09bf79a5ce', '569c7a3e-6a52-495e-b582-2099239685cc', 'a8ea00aa-9593-44de-a602-9c941c1058f9'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:51 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:32:51 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:52 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 1073741824" returned: 0 in 0.950s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:32:52 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.651s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:32:52 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 Sep 30 10:32:52 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:32:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-45c028f6-68d4-4d33-9afb-018554ac1eb4 tempest-GroupSnapshotsV319Test-2042435062 None] Delete group completed successfully. Sep 30 10:32:52 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3" returned: 0 in 0.504s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1036c0a-7d4d-44cf-addb-0fcf642a49f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d14546f-fca8-4b41-8dda-5ca750e40e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:32:52 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Volume volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 (e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3): created successfully Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d14546f-fca8-4b41-8dda-5ca750e40e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:32:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Flow 'volume_create_manager' (922af3e5-2646-4285-8aa5-d3bb1ede3a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:32:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ab87a37c-0bfc-4f79-850f-ff9cbbfa885d tempest-ServerRescueNegativeTestJSON-921697370 None] Created volume successfully. Sep 30 10:33:07 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=35,cinder:UPDATE=35,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:33:07 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=31,cinder:INSERT=10,cinder:UPDATE=34,cinder:DELETE=1 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:33:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Acquiring lock "cinder-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:33:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Lock "cinder-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:33:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Acquiring lock "cinder-quobyte-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:33:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Lock "cinder-quobyte-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3" acquired by "delete_volume" :: waited 0.049s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:33:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a7329e-ba05-4db5-9b96-0b37555dce0c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:33:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:15 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 Sep 30 10:33:15 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:16 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3" returned: 0 in 0.857s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:16 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3 Sep 30 10:33:16 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:17 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3" returned: 0 in 0.793s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Lock "cinder-quobyte-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3" released by "delete_volume" :: held 1.755s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:33:17 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Created reservations ['9720fee2-9a0d-42e7-98da-dc4c0ea81de6', '2dde6f18-4ec9-442f-9b81-c5ff66c8a9f1', 'da18edcb-12ae-4714-b9bb-e5f6db1c3eb3', '634b0dbb-aaed-4124-9d2b-6e1c53804eda'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:33:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:17 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:33:17 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:18 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.846s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:18 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:33:18 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Deleted volume successfully. Sep 30 10:33:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-827bc6ee-7b73-440f-bd00-44adfe2ddf66 tempest-ServerRescueNegativeTestJSON-921697370 None] Lock "cinder-e6e8526b-5d4f-4b5d-8cb2-06b0bacf75e3-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:33:27 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:33:28 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:33:29 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f377391b-48e2-4acd-b886-826c5a98bbdb tempest-GroupsTest-904886757 None] Group tempest-Group1-900682544: creating Sep 30 10:33:29 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f377391b-48e2-4acd-b886-826c5a98bbdb tempest-GroupsTest-904886757 None] Group tempest-Group1-900682544: created successfully Sep 30 10:33:29 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f377391b-48e2-4acd-b886-826c5a98bbdb tempest-GroupsTest-904886757 None] Create group completed successfully. Sep 30 10:33:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-569684fd-b717-4ce0-ae6c-3815ae6d8dec tempest-GroupsTest-904886757 None] Group tempest-Group2-560403833: creating Sep 30 10:33:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-569684fd-b717-4ce0-ae6c-3815ae6d8dec tempest-GroupsTest-904886757 None] Group tempest-Group2-560403833: created successfully Sep 30 10:33:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-569684fd-b717-4ce0-ae6c-3815ae6d8dec tempest-GroupsTest-904886757 None] Create group completed successfully. Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Flow 'volume_create_manager' (c339b941-32eb-4e1c-86ad-1b87448c5e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184dd081-b578-4b62-9557-ef1be89022f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184dd081-b578-4b62-9557-ef1be89022f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1984077370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63282b49-d01b-4e70-93fb-11722632dbc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86bfc7c4aea144b9a8666fd5998cb693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:33:32Z,use_quota=True,user_id='380dd2c3edb54eae8acab2f60e28dcff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a4b25b-ee7f-406a-bb2d-795c75f58f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a4b25b-ee7f-406a-bb2d-795c75f58f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800da9e8-904c-4d1a-8687-69f412a0d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800da9e8-904c-4d1a-8687-69f412a0d73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63282b49-d01b-4e70-93fb-11722632dbc5', 'volume_name': 'volume-63282b49-d01b-4e70-93fb-11722632dbc5', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08e9351-f4d7-4017-8869-9de4c3ba849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08e9351-f4d7-4017-8869-9de4c3ba849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7422cf8-832f-40f0-a3c2-3751effd3d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Volume 63282b49-d01b-4e70-93fb-11722632dbc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63282b49-d01b-4e70-93fb-11722632dbc5', 'volume_size': 1} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1984077370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63282b49-d01b-4e70-93fb-11722632dbc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86bfc7c4aea144b9a8666fd5998cb693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:33:32Z,use_quota=True,user_id='380dd2c3edb54eae8acab2f60e28dcff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Creating volume 63282b49-d01b-4e70-93fb-11722632dbc5 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:33:32 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:32 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5 1073741824 Sep 30 10:33:32 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:32 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5 1073741824" returned: 0 in 0.570s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:33 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5 Sep 30 10:33:33 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Flow 'volume_create_manager' (52f58f9f-5d55-41e0-a80b-9edb46652027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f0c649-629b-4ff7-850d-3638ce563018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f0c649-629b-4ff7-850d-3638ce563018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-783689428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7445f842-d77e-41e0-ba48-f5ce375d23e7,host='devstack@QuobyteHD#QuobyteHD',id=18bfc49e-660c-4699-8a24-47794ba4fad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df71566bcd3342b28a27055e75ef69cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:33:33Z,use_quota=True,user_id='c36fde9f68cf49dbae9588745d3c7baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7db5ee86-05f0-46dd-94e8-6eb983cda566),volume_type_id=7db5ee86-05f0-46dd-94e8-6eb983cda566)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c462f8-4466-4d15-8611-76011c118359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c462f8-4466-4d15-8611-76011c118359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e584cab-ea40-4d92-82a0-8235b13292c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e584cab-ea40-4d92-82a0-8235b13292c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18bfc49e-660c-4699-8a24-47794ba4fad1', 'volume_name': 'volume-18bfc49e-660c-4699-8a24-47794ba4fad1', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f47101b-cde5-4e97-825b-73de6aaeab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f47101b-cde5-4e97-825b-73de6aaeab42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7feee2b-bda5-4fef-a240-b4703f8944e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:33 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Volume 18bfc49e-660c-4699-8a24-47794ba4fad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18bfc49e-660c-4699-8a24-47794ba4fad1', 'volume_size': 1} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:33 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5" returned: 0 in 0.450s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.082s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7445f842-d77e-41e0-ba48-f5ce375d23e7,created_at=2026-09-30T08:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-783689428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7445f842-d77e-41e0-ba48-f5ce375d23e7,host='devstack@QuobyteHD#QuobyteHD',id=18bfc49e-660c-4699-8a24-47794ba4fad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df71566bcd3342b28a27055e75ef69cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:33:33Z,use_quota=True,user_id='c36fde9f68cf49dbae9588745d3c7baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7db5ee86-05f0-46dd-94e8-6eb983cda566),volume_type_id=7db5ee86-05f0-46dd-94e8-6eb983cda566)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Creating volume 18bfc49e-660c-4699-8a24-47794ba4fad1 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:33:33 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:33 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1 1073741824 Sep 30 10:33:33 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7422cf8-832f-40f0-a3c2-3751effd3d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63282b49-d01b-4e70-93fb-11722632dbc5', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef4a7d4-35bc-4db6-b73b-6cc0c627572b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:33 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Volume volume-63282b49-d01b-4e70-93fb-11722632dbc5 (63282b49-d01b-4e70-93fb-11722632dbc5): created successfully Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef4a7d4-35bc-4db6-b73b-6cc0c627572b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Flow 'volume_create_manager' (c339b941-32eb-4e1c-86ad-1b87448c5e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:33:33 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2f7fdfd9-ea5a-4b08-a8d5-bdfb8b06a5f1 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Created volume successfully. Sep 30 10:33:34 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1 1073741824" returned: 0 in 0.608s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:34 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1 Sep 30 10:33:34 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:34 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1" returned: 0 in 0.414s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:33:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7feee2b-bda5-4fef-a240-b4703f8944e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18bfc49e-660c-4699-8a24-47794ba4fad1', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d610d247-aa5c-4f90-a38d-45aa100caa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:34 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Volume volume-18bfc49e-660c-4699-8a24-47794ba4fad1 (18bfc49e-660c-4699-8a24-47794ba4fad1): created successfully Sep 30 10:33:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d610d247-aa5c-4f90-a38d-45aa100caa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Flow 'volume_create_manager' (52f58f9f-5d55-41e0-a80b-9edb46652027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:33:34 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f18bc424-86ef-4d6a-9a45-0f2f98c3d27f tempest-GroupsTest-904886757 None] Created volume successfully. Sep 30 10:33:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c71c446c-57ba-4202-bcbb-b937b30f0e33 req-2940053a-6b7b-42eb-9b18-734cb5761a04 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c71c446c-57ba-4202-bcbb-b937b30f0e33 req-2940053a-6b7b-42eb-9b18-734cb5761a04 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c71c446c-57ba-4202-bcbb-b937b30f0e33 req-2940053a-6b7b-42eb-9b18-734cb5761a04 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-c71c446c-57ba-4202-bcbb-b937b30f0e33 req-2940053a-6b7b-42eb-9b18-734cb5761a04 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-63282b49-d01b-4e70-93fb-11722632dbc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5ccc751-0343-44ed-b34c-d302ce8b9782', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:33:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-c71c446c-57ba-4202-bcbb-b937b30f0e33 req-2940053a-6b7b-42eb-9b18-734cb5761a04 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] attachment_update completed successfully. Sep 30 10:33:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Acquiring lock "cinder-quobyte-18bfc49e-660c-4699-8a24-47794ba4fad1" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:33:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Lock "cinder-quobyte-18bfc49e-660c-4699-8a24-47794ba4fad1" acquired by "delete_volume" :: waited 0.033s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:33:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aa235a-abe3-4de7-99b3-b5dcf634e978]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:33:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:37 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:33:37 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:37 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1 Sep 30 10:33:37 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:37 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.402s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 28 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:33:37 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1" returned: 0 in 0.624s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:37 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1 Sep 30 10:33:37 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:37 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-18bfc49e-660c-4699-8a24-47794ba4fad1" returned: 0 in 0.432s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Lock "cinder-quobyte-18bfc49e-660c-4699-8a24-47794ba4fad1" released by "delete_volume" :: held 1.148s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Created reservations ['eaa0b54e-71b5-4382-9dbf-c0e2bbfffd41'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:33:38 devstack cinder-volume[87013]: WARNING cinder.quota [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-321583103 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-321583103, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:33:38 devstack cinder-volume[87013]: WARNING cinder.quota [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-321583103 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-321583103, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Created reservations ['54a175f4-6c09-4937-81df-ca347b363737', '77bf3e7e-de71-4daf-82e1-ac6afb7915ee', '7729b847-c865-4ec1-80b0-3c37dc86547a', '09228463-2fd6-462d-a6df-228bdac82b2b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:38 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:33:38 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:38 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.370s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:38 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:33:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-68b70d15-02a5-4fc3-b768-e6f31f3060dc tempest-GroupsTest-904886757 None] Delete group completed successfully. Sep 30 10:33:39 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ed2a4f4f-fe66-40d3-9404-66c13b194582 tempest-GroupsTest-904886757 None] Created reservations ['10b7852c-2357-49af-9baa-934f5f620f85'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:33:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ed2a4f4f-fe66-40d3-9404-66c13b194582 tempest-GroupsTest-904886757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ed2a4f4f-fe66-40d3-9404-66c13b194582 tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a4f4f-fe66-40d3-9404-66c13b194582 tempest-GroupsTest-904886757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a4f4f-fe66-40d3-9404-66c13b194582 tempest-GroupsTest-904886757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ed2a4f4f-fe66-40d3-9404-66c13b194582 tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed2a4f4f-fe66-40d3-9404-66c13b194582 tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:39 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:33:39 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:40 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed2a4f4f-fe66-40d3-9404-66c13b194582 tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.421s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:40 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-ed2a4f4f-fe66-40d3-9404-66c13b194582 tempest-GroupsTest-904886757 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:33:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-3985501e-fd9c-458b-a878-af81a8ceb7bc req-79500565-af9d-49ef-9206-422f1123d6b4 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Terminate volume connection completed successfully. Sep 30 10:33:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-3985501e-fd9c-458b-a878-af81a8ceb7bc req-79500565-af9d-49ef-9206-422f1123d6b4 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Deleting attachment f5ccc751-0343-44ed-b34c-d302ce8b9782. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:33:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ed2a4f4f-fe66-40d3-9404-66c13b194582 tempest-GroupsTest-904886757 None] Delete group completed successfully. Sep 30 10:33:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Acquiring lock "cinder-63282b49-d01b-4e70-93fb-11722632dbc5-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:33:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "cinder-63282b49-d01b-4e70-93fb-11722632dbc5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:33:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Acquiring lock "cinder-quobyte-63282b49-d01b-4e70-93fb-11722632dbc5" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:33:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "cinder-quobyte-63282b49-d01b-4e70-93fb-11722632dbc5" acquired by "delete_volume" :: waited 0.032s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:33:40 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[121c3489-b0a7-4d0f-9563-ed5a426fe10a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:33:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:41 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5 Sep 30 10:33:41 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:41 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5" returned: 0 in 0.512s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:41 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5 Sep 30 10:33:41 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:41 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-00154ca4-7afe-4497-8258-a7dcd40f8847 tempest-GroupsTest-904886757 None] Group tempest-GroupsTest-Group-1858582276: creating Sep 30 10:33:41 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-00154ca4-7afe-4497-8258-a7dcd40f8847 tempest-GroupsTest-904886757 None] Group tempest-GroupsTest-Group-1858582276: created successfully Sep 30 10:33:41 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-63282b49-d01b-4e70-93fb-11722632dbc5" returned: 0 in 0.339s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:41 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-00154ca4-7afe-4497-8258-a7dcd40f8847 tempest-GroupsTest-904886757 None] Create group completed successfully. Sep 30 10:33:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "cinder-quobyte-63282b49-d01b-4e70-93fb-11722632dbc5" released by "delete_volume" :: held 0.925s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:33:41 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Created reservations ['d7cd6a5e-a310-4dd2-abfa-9dd120badcec', 'fe896913-56ca-41bf-ab6e-8a1f581c26d5', 'b3b32fb2-e9be-4780-88c5-cd844dcc0d79', '15a9cf71-40f8-4862-a682-84f6d1b20f02'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:33:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:42 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:33:42 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:42 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.324s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:42 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:33:42 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Deleted volume successfully. Sep 30 10:33:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c01e806d-08c7-420a-b8ea-f49fdce9b065 tempest-TestServerVolumeAttachScenarioOldVersion-797322101 None] Lock "cinder-63282b49-d01b-4e70-93fb-11722632dbc5-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Flow 'volume_create_manager' (a45707ba-b86e-4d3d-be3f-17fa021e75d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a47b683-f6dd-4284-bf55-069874f8b439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a47b683-f6dd-4284-bf55-069874f8b439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2145030123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6db9e6b3-a50e-4d51-a189-ea9ff29b5982,host='devstack@QuobyteHD#QuobyteHD',id=cffe2e8d-097b-47fc-b764-9476706d3400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df71566bcd3342b28a27055e75ef69cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:33:43Z,use_quota=True,user_id='c36fde9f68cf49dbae9588745d3c7baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(118fafbe-36c9-423a-a45c-97eac73b63f5),volume_type_id=118fafbe-36c9-423a-a45c-97eac73b63f5)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdf39f4-14b0-45d6-9f2d-d8abc288a445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdf39f4-14b0-45d6-9f2d-d8abc288a445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2b0f6f-53b1-4a99-be33-4455001c8c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2b0f6f-53b1-4a99-be33-4455001c8c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cffe2e8d-097b-47fc-b764-9476706d3400', 'volume_name': 'volume-cffe2e8d-097b-47fc-b764-9476706d3400', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1095b008-9e8b-497e-8bbd-86cfcf4af3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1095b008-9e8b-497e-8bbd-86cfcf4af3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8804a3cc-a98b-4dde-85ec-a9ee5aeb91ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:43 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Volume cffe2e8d-097b-47fc-b764-9476706d3400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cffe2e8d-097b-47fc-b764-9476706d3400', 'volume_size': 1} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6db9e6b3-a50e-4d51-a189-ea9ff29b5982,created_at=2026-09-30T08:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2145030123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6db9e6b3-a50e-4d51-a189-ea9ff29b5982,host='devstack@QuobyteHD#QuobyteHD',id=cffe2e8d-097b-47fc-b764-9476706d3400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df71566bcd3342b28a27055e75ef69cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:33:43Z,use_quota=True,user_id='c36fde9f68cf49dbae9588745d3c7baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(118fafbe-36c9-423a-a45c-97eac73b63f5),volume_type_id=118fafbe-36c9-423a-a45c-97eac73b63f5)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Creating volume cffe2e8d-097b-47fc-b764-9476706d3400 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:33:43 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:33:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:43 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400 1073741824 Sep 30 10:33:43 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:44 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400 1073741824" returned: 0 in 0.842s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:44 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400 Sep 30 10:33:44 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Flow 'volume_create_manager' (4697c27b-e094-4115-9e13-9d6fff6b5c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9005f1ca-428f-4c59-be61-5feb1bafcc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9005f1ca-428f-4c59-be61-5feb1bafcc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-838229444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9e6f04-9013-430c-a124-289a23c5d1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687aa87d2ac4c8e9d10f07ab76999b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:33:45Z,use_quota=True,user_id='3657c940b23142099ab5bf3dbdf463ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84f044f-473e-4376-9827-617c58d8998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84f044f-473e-4376-9827-617c58d8998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d85c17-88fc-4bfa-a65b-9922cad1d182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d85c17-88fc-4bfa-a65b-9922cad1d182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec9e6f04-9013-430c-a124-289a23c5d1bd', 'volume_name': 'volume-ec9e6f04-9013-430c-a124-289a23c5d1bd', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a877eee-1238-48ed-b263-e65c2e2e0f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a877eee-1238-48ed-b263-e65c2e2e0f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbb1ee3-2bf5-4f30-9b52-fb0af994f610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:44 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Volume ec9e6f04-9013-430c-a124-289a23c5d1bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec9e6f04-9013-430c-a124-289a23c5d1bd', 'volume_size': 1} Sep 30 10:33:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:45 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400" returned: 0 in 0.418s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-838229444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9e6f04-9013-430c-a124-289a23c5d1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687aa87d2ac4c8e9d10f07ab76999b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:33:45Z,use_quota=True,user_id='3657c940b23142099ab5bf3dbdf463ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Creating volume ec9e6f04-9013-430c-a124-289a23c5d1bd {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:33:45 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8804a3cc-a98b-4dde-85ec-a9ee5aeb91ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffe2e8d-097b-47fc-b764-9476706d3400', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91471996-9310-4fd2-a929-8ee6790e79d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:45 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd 1073741824 Sep 30 10:33:45 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:45 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Volume volume-cffe2e8d-097b-47fc-b764-9476706d3400 (cffe2e8d-097b-47fc-b764-9476706d3400): created successfully Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91471996-9310-4fd2-a929-8ee6790e79d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Flow 'volume_create_manager' (a45707ba-b86e-4d3d-be3f-17fa021e75d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:33:45 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-348055bb-34b8-422b-89a8-dcc5ee7b96f0 tempest-GroupsTest-904886757 None] Created volume successfully. Sep 30 10:33:45 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd 1073741824" returned: 0 in 0.643s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:45 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd Sep 30 10:33:45 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:46 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd" returned: 0 in 0.545s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:33:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbb1ee3-2bf5-4f30-9b52-fb0af994f610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec9e6f04-9013-430c-a124-289a23c5d1bd', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a542188e-c32a-4b58-ae9d-f04ebc9a91d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:46 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Volume volume-ec9e6f04-9013-430c-a124-289a23c5d1bd (ec9e6f04-9013-430c-a124-289a23c5d1bd): created successfully Sep 30 10:33:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a542188e-c32a-4b58-ae9d-f04ebc9a91d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Flow 'volume_create_manager' (4697c27b-e094-4115-9e13-9d6fff6b5c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:33:46 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fa9cc76e-9108-4f02-86d2-6085f727d40c tempest-TestStampPattern-1955448536 None] Created volume successfully. Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Flow 'volume_create_manager' (53b26419-08a1-434d-a1ba-4962ad8d8ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd26d01c-dd18-4890-b6e8-edc80607e9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd26d01c-dd18-4890-b6e8-edc80607e9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451346787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6db9e6b3-a50e-4d51-a189-ea9ff29b5982,host='devstack@QuobyteHD#QuobyteHD',id=f92c7be2-7da8-4763-b847-e0e2e890697b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df71566bcd3342b28a27055e75ef69cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:33:47Z,use_quota=True,user_id='c36fde9f68cf49dbae9588745d3c7baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(118fafbe-36c9-423a-a45c-97eac73b63f5),volume_type_id=118fafbe-36c9-423a-a45c-97eac73b63f5)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256ff879-886f-4ed5-ba03-2e4f68e4c56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256ff879-886f-4ed5-ba03-2e4f68e4c56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061afef7-1d72-411a-9160-1e7ab0bc46cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061afef7-1d72-411a-9160-1e7ab0bc46cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f92c7be2-7da8-4763-b847-e0e2e890697b', 'volume_name': 'volume-f92c7be2-7da8-4763-b847-e0e2e890697b', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef37931-5e95-4e6f-9f48-5d38b8c4a529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef37931-5e95-4e6f-9f48-5d38b8c4a529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6212ffcf-021f-4c3d-8516-b3dffca73f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:47 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Volume f92c7be2-7da8-4763-b847-e0e2e890697b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f92c7be2-7da8-4763-b847-e0e2e890697b', 'volume_size': 1} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6db9e6b3-a50e-4d51-a189-ea9ff29b5982,created_at=2026-09-30T08:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451346787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6db9e6b3-a50e-4d51-a189-ea9ff29b5982,host='devstack@QuobyteHD#QuobyteHD',id=f92c7be2-7da8-4763-b847-e0e2e890697b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df71566bcd3342b28a27055e75ef69cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:33:47Z,use_quota=True,user_id='c36fde9f68cf49dbae9588745d3c7baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(118fafbe-36c9-423a-a45c-97eac73b63f5),volume_type_id=118fafbe-36c9-423a-a45c-97eac73b63f5)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Creating volume f92c7be2-7da8-4763-b847-e0e2e890697b {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:33:47 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:47 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b 1073741824 Sep 30 10:33:47 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:47 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b 1073741824" returned: 0 in 0.677s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:48 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b Sep 30 10:33:48 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:48 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b" returned: 0 in 0.451s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:33:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6212ffcf-021f-4c3d-8516-b3dffca73f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f92c7be2-7da8-4763-b847-e0e2e890697b', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4e6e8f-170c-41b2-851a-64583a4d3acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:33:48 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Volume volume-f92c7be2-7da8-4763-b847-e0e2e890697b (f92c7be2-7da8-4763-b847-e0e2e890697b): created successfully Sep 30 10:33:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4e6e8f-170c-41b2-851a-64583a4d3acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:33:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Flow 'volume_create_manager' (53b26419-08a1-434d-a1ba-4962ad8d8ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:33:48 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-58fd2242-9a93-4be2-b560-25be2ae5bf61 tempest-GroupsTest-904886757 None] Created volume successfully. Sep 30 10:33:49 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-4fa0d403-eee4-4b18-921f-803f22fc53a1 tempest-GroupsTest-904886757 None] Update group completed successfully. Sep 30 10:33:51 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b4507812-30e8-4fe1-9de2-46f0a8afe38e tempest-GroupsTest-904886757 None] Update group completed successfully. Sep 30 10:33:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Acquiring lock "cinder-quobyte-cffe2e8d-097b-47fc-b764-9476706d3400" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:33:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Lock "cinder-quobyte-cffe2e8d-097b-47fc-b764-9476706d3400" acquired by "delete_volume" :: waited 0.050s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:33:53 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[694de145-3abc-4d87-af67-dda596838ebb]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:33:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:53 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400 Sep 30 10:33:53 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:54 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400" returned: 0 in 0.792s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:54 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400 Sep 30 10:33:54 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:54 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cffe2e8d-097b-47fc-b764-9476706d3400" returned: 0 in 0.431s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Lock "cinder-quobyte-cffe2e8d-097b-47fc-b764-9476706d3400" released by "delete_volume" :: held 1.378s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:33:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Acquiring lock "cinder-quobyte-f92c7be2-7da8-4763-b847-e0e2e890697b" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:33:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Lock "cinder-quobyte-f92c7be2-7da8-4763-b847-e0e2e890697b" acquired by "delete_volume" :: waited 0.032s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:33:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[72908d29-e52b-41b3-bcfe-da57d0fe70a3]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:33:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:55 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b Sep 30 10:33:55 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:55 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b" returned: 0 in 0.527s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:55 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b Sep 30 10:33:55 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:55 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f92c7be2-7da8-4763-b847-e0e2e890697b" returned: 0 in 0.455s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Lock "cinder-quobyte-f92c7be2-7da8-4763-b847-e0e2e890697b" released by "delete_volume" :: held 1.072s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:33:56 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Created reservations ['f2658f37-f373-4160-8a17-bd8abc2cfd94'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:33:56 devstack cinder-volume[87013]: WARNING cinder.quota [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1337506661 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1337506661, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:33:56 devstack cinder-volume[87013]: WARNING cinder.quota [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1337506661 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1337506661, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:33:56 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Created reservations ['79f8463a-9a4e-448a-9b84-0877a2745229', '00a40161-72fc-4e53-b02a-b756aab5d58b', '9efa181c-956d-4e86-95a0-0874c1bb690c', '03e96786-d4d9-41f6-a658-ced53c3d7bf5'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:33:56 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Created reservations ['1f248359-d5b1-4653-97c8-0f8bbee6afc8', '0f36d4a1-b089-4e70-be2e-ab20cd8a42a0', '9b744eb8-9cf6-47b3-9fca-400b8dbceaa1', '9c278743-7afe-43e2-8d1e-bd5c3b27a000'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:33:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:33:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:33:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:33:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:33:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:33:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:33:56 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:33:56 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:33:57 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Sep 30 10:33:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.787s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:33:57 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:33:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-4d863b46-486c-48d0-97d0-0e68c5157eef tempest-GroupsTest-904886757 None] Delete group completed successfully. Sep 30 10:34:06 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=55,cinder:SELECT=58,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:34:06 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=57,cinder:UPDATE=67,cinder:DELETE=3,cinder:INSERT=12 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:34:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c4f58f49-e283-4fff-9515-10b89b89209a req-cb39c24d-7f66-4604-bf7e-886607019a49 tempest-TestStampPattern-1955448536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c4f58f49-e283-4fff-9515-10b89b89209a req-cb39c24d-7f66-4604-bf7e-886607019a49 tempest-TestStampPattern-1955448536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-c4f58f49-e283-4fff-9515-10b89b89209a req-cb39c24d-7f66-4604-bf7e-886607019a49 tempest-TestStampPattern-1955448536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-c4f58f49-e283-4fff-9515-10b89b89209a req-cb39c24d-7f66-4604-bf7e-886607019a49 tempest-TestStampPattern-1955448536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-ec9e6f04-9013-430c-a124-289a23c5d1bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6440bf4-e90b-497d-9796-1589a525d7a4', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:34:24 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-c4f58f49-e283-4fff-9515-10b89b89209a req-cb39c24d-7f66-4604-bf7e-886607019a49 tempest-TestStampPattern-1955448536 None] attachment_update completed successfully. Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Flow 'volume_create_manager' (021b2c41-5a1d-484e-a2f2-e09c25051aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd013915-2777-4132-9599-889d22e6f95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd013915-2777-4132-9599-889d22e6f95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-68455956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9356da7e-d02e-4b4e-959a-fb476fb3d80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b98842a4b654a1cabfa76757bcf9004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:34:31Z,use_quota=True,user_id='297a38c6a62c4b1a8340b555f9053bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a9aefc-7ed8-4b53-aa63-bb12563149f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a9aefc-7ed8-4b53-aa63-bb12563149f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1cbe49-0aec-4439-b545-c7bfb863d648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1cbe49-0aec-4439-b545-c7bfb863d648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9356da7e-d02e-4b4e-959a-fb476fb3d80d', 'volume_name': 'volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569a0f96-fcac-438a-9bbb-79b5f043a7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569a0f96-fcac-438a-9bbb-79b5f043a7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48c2873-11d9-4d62-a9b4-3eafecf25755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Volume 9356da7e-d02e-4b4e-959a-fb476fb3d80d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d', 'volume_size': 1} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-68455956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9356da7e-d02e-4b4e-959a-fb476fb3d80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b98842a4b654a1cabfa76757bcf9004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:34:31Z,use_quota=True,user_id='297a38c6a62c4b1a8340b555f9053bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Creating volume 9356da7e-d02e-4b4e-959a-fb476fb3d80d {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:34:31 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:34:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:31 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d 1073741824 Sep 30 10:34:31 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-c65ba046-aa11-46b8-ada0-856aa5c95428 req-c56ec7f0-6fcb-46e5-a1f2-6a8cea167aa4 tempest-TestStampPattern-1955448536 None] Terminate volume connection completed successfully. Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-c65ba046-aa11-46b8-ada0-856aa5c95428 req-c56ec7f0-6fcb-46e5-a1f2-6a8cea167aa4 tempest-TestStampPattern-1955448536 None] Deleting attachment c6440bf4-e90b-497d-9796-1589a525d7a4. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:34:32 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d 1073741824" returned: 0 in 0.621s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:32 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d Sep 30 10:34:32 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:32 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d" returned: 0 in 0.402s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48c2873-11d9-4d62-a9b4-3eafecf25755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d84b956-554b-45c8-bf6d-f378210d70e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Volume volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d (9356da7e-d02e-4b4e-959a-fb476fb3d80d): created successfully Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d84b956-554b-45c8-bf6d-f378210d70e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Flow 'volume_create_manager' (021b2c41-5a1d-484e-a2f2-e09c25051aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:34:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e1bb4e74-7a85-4594-b340-c07f73a96ff1 tempest-ServersNegativeTestJSON-886523974 None] Created volume successfully. Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Creating offline snapshot 08f15853-2500-45c7-936a-d71db3ed8891 of volume ec9e6f04-9013-430c-a124-289a23c5d1bd {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27ab626-d248-4d85-bc1c-538f42db0c1a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:34:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:33 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd Sep 30 10:34:33 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:33 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd" returned: 0 in 0.473s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:33 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 1G Sep 30 10:34:33 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:33 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 1G" returned: 0 in 0.551s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9e6f04-9013-430c-a124-289a23c5d1bd -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:34 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9e6f04-9013-430c-a124-289a23c5d1bd -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 Sep 30 10:34:34 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:34 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9e6f04-9013-430c-a124-289a23c5d1bd -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891" returned: 0 in 0.484s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:34 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 is being set with open permissions: ugo+rw Sep 30 10:34:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:34 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 Sep 30 10:34:34 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:34 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891" returned: 0 in 0.285s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:34 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.info Sep 30 10:34:34 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Flow 'volume_create_manager' (f829b7fd-87fa-413d-98a1-2cd543e06c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d11272-8182-4686-b63c-1e681f954c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d11272-8182-4686-b63c-1e681f954c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-913553591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5af3884-926d-4d34-84e5-15a1d93f2706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b98842a4b654a1cabfa76757bcf9004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:34:35Z,use_quota=True,user_id='297a38c6a62c4b1a8340b555f9053bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed41274-846a-4123-95c1-e99a7ad135f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed41274-846a-4123-95c1-e99a7ad135f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8cb04f-b9ee-4200-88ad-86a1b6577952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8cb04f-b9ee-4200-88ad-86a1b6577952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5af3884-926d-4d34-84e5-15a1d93f2706', 'volume_name': 'volume-b5af3884-926d-4d34-84e5-15a1d93f2706', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:35 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d990539-6fb4-44b0-9e01-1b8e689c2092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d990539-6fb4-44b0-9e01-1b8e689c2092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a52d79-664a-454d-911e-88b01e871138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:35 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Volume b5af3884-926d-4d34-84e5-15a1d93f2706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5af3884-926d-4d34-84e5-15a1d93f2706', 'volume_size': 1} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.info" returned: 0 in 0.452s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:35 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.info is being set with open permissions: ugo+rw Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:35 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.info Sep 30 10:34:35 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:35 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.info" returned: 0 in 0.289s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-913553591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5af3884-926d-4d34-84e5-15a1d93f2706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b98842a4b654a1cabfa76757bcf9004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:34:35Z,use_quota=True,user_id='297a38c6a62c4b1a8340b555f9053bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Creating volume b5af3884-926d-4d34-84e5-15a1d93f2706 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:34:35 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:34:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:35 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706 1073741824 Sep 30 10:34:35 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c2ec7728-eb5c-4f3e-81c7-272c6944573e tempest-TestStampPattern-1955448536 None] Create snapshot completed successfully Sep 30 10:34:36 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706 1073741824" returned: 0 in 0.650s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:36 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706 Sep 30 10:34:36 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:36 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706" returned: 0 in 0.433s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:34:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a52d79-664a-454d-911e-88b01e871138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5af3884-926d-4d34-84e5-15a1d93f2706', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef180838-c7ac-4785-a0d2-108c1118b6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:36 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Volume volume-b5af3884-926d-4d34-84e5-15a1d93f2706 (b5af3884-926d-4d34-84e5-15a1d93f2706): created successfully Sep 30 10:34:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef180838-c7ac-4785-a0d2-108c1118b6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Flow 'volume_create_manager' (f829b7fd-87fa-413d-98a1-2cd543e06c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:34:36 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-72fcccba-a792-4d82-9e9e-78d4866930ee tempest-ServersNegativeTestJSON-886523974 None] Created volume successfully. Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:37 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:34:37 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:37 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.357s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:34:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:34:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Acquiring lock "cinder-b5af3884-926d-4d34-84e5-15a1d93f2706-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:34:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Lock "cinder-b5af3884-926d-4d34-84e5-15a1d93f2706-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:34:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Acquiring lock "cinder-quobyte-b5af3884-926d-4d34-84e5-15a1d93f2706" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:34:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Lock "cinder-quobyte-b5af3884-926d-4d34-84e5-15a1d93f2706" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:34:39 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[47519bf5-facc-448f-a056-e0f7febf4917]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:34:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:39 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706 Sep 30 10:34:39 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:39 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706" returned: 0 in 0.566s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:39 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706 Sep 30 10:34:39 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:39 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-b5af3884-926d-4d34-84e5-15a1d93f2706" returned: 0 in 0.293s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Lock "cinder-quobyte-b5af3884-926d-4d34-84e5-15a1d93f2706" released by "delete_volume" :: held 0.925s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:34:40 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Created reservations ['45cc48f7-44c3-48d7-9b1a-7a531017b939', '513fdcda-0923-49d1-a16d-d5b71b0b5a80', '00d816a0-97b4-4a23-91c8-0c32f04c1271', '11830f80-2eda-4c9d-b479-a106b3c02c40'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:34:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:34:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:34:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:40 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:34:40 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:40 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.374s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:40 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:34:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Deleted volume successfully. Sep 30 10:34:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504e0cf6-4953-4af2-a53b-7ebfa095fd58 tempest-ServersNegativeTestJSON-886523974 None] Lock "cinder-b5af3884-926d-4d34-84e5-15a1d93f2706-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:34:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Acquiring lock "cinder-9356da7e-d02e-4b4e-959a-fb476fb3d80d-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:34:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Lock "cinder-9356da7e-d02e-4b4e-959a-fb476fb3d80d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:34:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Acquiring lock "cinder-quobyte-9356da7e-d02e-4b4e-959a-fb476fb3d80d" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:34:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Lock "cinder-quobyte-9356da7e-d02e-4b4e-959a-fb476fb3d80d" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:34:41 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a060c0-3479-4790-add9-a9d4e76bf199]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:34:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:41 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d Sep 30 10:34:41 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:42 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d" returned: 0 in 0.599s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:42 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d Sep 30 10:34:42 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:42 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9356da7e-d02e-4b4e-959a-fb476fb3d80d" returned: 0 in 0.348s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Lock "cinder-quobyte-9356da7e-d02e-4b4e-959a-fb476fb3d80d" released by "delete_volume" :: held 1.032s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Created reservations ['2d0e0d1d-6c3a-41e0-8366-245e8e6c2009', 'b729f36a-4d20-4dc9-9b21-bb4b2a4cb938', '7a68443f-3619-40a8-a624-3184f1f227cf', '8ddbcd1d-f3d7-4554-b040-aaf96a945847'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:42 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:34:42 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:43 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.360s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:43 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:34:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Deleted volume successfully. Sep 30 10:34:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-10541274-50e7-44ce-8a47-2771817d8a3b tempest-ServersNegativeTestJSON-886523974 None] Lock "cinder-9356da7e-d02e-4b4e-959a-fb476fb3d80d-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Flow 'volume_create_manager' (2ddc44e5-ffa8-4861-bd34-3d944d3b6c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5456ad66-ed46-4774-8a14-80e88c67bb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5456ad66-ed46-4774-8a14-80e88c67bb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1483508807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfaa87d-64d4-499f-98e5-7e9d8a5fb063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8687aa87d2ac4c8e9d10f07ab76999b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08f15853-2500-45c7-936a-d71db3ed8891,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:34:46Z,use_quota=True,user_id='3657c940b23142099ab5bf3dbdf463ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3647f5d8-3e09-42f1-aeda-831e2184cf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3647f5d8-3e09-42f1-aeda-831e2184cf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df849d84-f2e9-4866-885e-65ddfea81890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df849d84-f2e9-4866-885e-65ddfea81890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'edfaa87d-64d4-499f-98e5-7e9d8a5fb063', 'volume_name': 'volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063', 'volume_size': 1, 'snapshot_id': '08f15853-2500-45c7-936a-d71db3ed8891'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900b0778-8e86-4c7a-94ac-a782dd26fa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900b0778-8e86-4c7a-94ac-a782dd26fa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3278cc7d-ad1f-45e8-9104-312dfd8a0075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:46 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Volume edfaa87d-64d4-499f-98e5-7e9d8a5fb063: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063', 'volume_size': 1, 'snapshot_id': '08f15853-2500-45c7-936a-d71db3ed8891'} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Acquiring lock "cinder-quobyte-08f15853-2500-45c7-936a-d71db3ed8891-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" by "_create_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-08f15853-2500-45c7-936a-d71db3ed8891-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Creating volume edfaa87d-64d4-499f-98e5-7e9d8a5fb063 from snapshot 08f15853-2500-45c7-936a-d71db3ed8891 {{(pid=87013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Acquiring lock "cinder-quobyte-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] snapshot: 08f15853-2500-45c7-936a-d71db3ed8891, volume: edfaa87d-64d4-499f-98e5-7e9d8a5fb063, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef17e87-cfdb-463d-94b4-db51930e78de]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:34:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:46 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 Sep 30 10:34:46 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:47 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891" returned: 0 in 0.714s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec9e6f04-9013-430c-a124-289a23c5d1bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:34:47 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[37255d9e-13ce-4010-ba70-a981f298c39f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:34:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:47 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd Sep 30 10:34:47 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:47 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd" returned: 0 in 0.617s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:34:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:34:47 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:34:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:47 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 Sep 30 10:34:47 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Flow 'volume_create_manager' (77a0a3c8-de3a-4bef-bb3a-a7e2a5c840d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302b1fee-b16c-43d7-b9af-9faf17ade4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302b1fee-b16c-43d7-b9af-9faf17ade4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2040127926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba8dcac-d861-488a-997e-4b38fad454ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8338e5fee7e3404caaf34ba2feb8760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:34:49Z,use_quota=True,user_id='86da0ce173d547a7adaf7bc9d7587b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e3a27f-85af-4489-b944-05e5efc2f171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e3a27f-85af-4489-b944-05e5efc2f171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9811e2ca-b90d-4ce0-9d53-b4d39817aa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9811e2ca-b90d-4ce0-9d53-b4d39817aa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba8dcac-d861-488a-997e-4b38fad454ae', 'volume_name': 'volume-3ba8dcac-d861-488a-997e-4b38fad454ae', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f95cfb3-4991-4702-ab45-399369dfe33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f95cfb3-4991-4702-ab45-399369dfe33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d0c187-e32c-4f85-965b-7487105430ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:48 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Volume 3ba8dcac-d861-488a-997e-4b38fad454ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba8dcac-d861-488a-997e-4b38fad454ae', 'volume_size': 1} Sep 30 10:34:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Flow 'volume_create_manager' (955ec28a-1030-4a35-a6ea-127466bb456e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c2b469-175d-4947-b10e-4386583a14e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c2b469-175d-4947-b10e-4386583a14e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1573033898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca4eeb2-5a6e-4ae0-882b-66a9a6562891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8338e5fee7e3404caaf34ba2feb8760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:34:49Z,use_quota=True,user_id='86da0ce173d547a7adaf7bc9d7587b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a236c13d-49f6-4644-985d-fd1b05635511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a236c13d-49f6-4644-985d-fd1b05635511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c92436-c8e2-4593-ae4d-5e87921f7baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c92436-c8e2-4593-ae4d-5e87921f7baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca4eeb2-5a6e-4ae0-882b-66a9a6562891', 'volume_name': 'volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbb34d5-066f-4ae0-a7a4-72ff6707414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbb34d5-066f-4ae0-a7a4-72ff6707414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ff4663-bd34-47e7-ae04-1c6864d0156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:49 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Volume 6ca4eeb2-5a6e-4ae0-882b-66a9a6562891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891', 'volume_size': 1} Sep 30 10:34:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:58 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" returned: 0 in 10.974s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:58 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd, size 1024.00 MB, duration 10.98 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:34:58 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Converted 1024.00 MB image at 93.30 MB/s Sep 30 10:34:58 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 is being set with open permissions: ugo+rw Sep 30 10:34:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:58 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 Sep 30 10:34:58 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:59 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" returned: 0 in 0.385s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" released by "_copy_volume_from_snapshot" :: held 12.885s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-08f15853-2500-45c7-936a-d71db3ed8891-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" released by "_create_volume_from_snapshot" :: held 13.005s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.044s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.591s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2040127926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba8dcac-d861-488a-997e-4b38fad454ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8338e5fee7e3404caaf34ba2feb8760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:34:49Z,use_quota=True,user_id='86da0ce173d547a7adaf7bc9d7587b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Creating volume 3ba8dcac-d861-488a-997e-4b38fad454ae {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:34:59 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:34:59 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae 1073741824 Sep 30 10:34:59 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3278cc7d-ad1f-45e8-9104-312dfd8a0075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063', 'volume_size': 1, 'snapshot_id': '08f15853-2500-45c7-936a-d71db3ed8891'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20671917-60eb-4039-acd4-7c70e70c37bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:34:59 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Volume volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 (edfaa87d-64d4-499f-98e5-7e9d8a5fb063): created successfully Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20671917-60eb-4039-acd4-7c70e70c37bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:34:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Flow 'volume_create_manager' (2ddc44e5-ffa8-4861-bd34-3d944d3b6c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:34:59 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fb291503-c329-4639-a43b-72b350a58c13 tempest-TestStampPattern-1955448536 None] Created volume successfully. Sep 30 10:35:00 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae 1073741824" returned: 0 in 0.797s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:00 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae Sep 30 10:35:00 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:00 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae" returned: 0 in 0.471s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.961s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1573033898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca4eeb2-5a6e-4ae0-882b-66a9a6562891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8338e5fee7e3404caaf34ba2feb8760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:34:49Z,use_quota=True,user_id='86da0ce173d547a7adaf7bc9d7587b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Creating volume 6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:35:00 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d0c187-e32c-4f85-965b-7487105430ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba8dcac-d861-488a-997e-4b38fad454ae', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64734d6d-97a9-4d68-a18c-65628ebbff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:00 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 1073741824 Sep 30 10:35:00 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:00 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Volume volume-3ba8dcac-d861-488a-997e-4b38fad454ae (3ba8dcac-d861-488a-997e-4b38fad454ae): created successfully Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64734d6d-97a9-4d68-a18c-65628ebbff13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Flow 'volume_create_manager' (77a0a3c8-de3a-4bef-bb3a-a7e2a5c840d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:35:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-75f2076d-ca35-49af-a603-42c9ea31d372 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Created volume successfully. Sep 30 10:35:01 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 1073741824" returned: 0 in 0.953s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:01 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 Sep 30 10:35:01 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:02 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891" returned: 0 in 0.491s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:35:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ff4663-bd34-47e7-ae04-1c6864d0156a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f022ac19-dbc4-46f8-881f-91708be07e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:02 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Volume volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 (6ca4eeb2-5a6e-4ae0-882b-66a9a6562891): created successfully Sep 30 10:35:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f022ac19-dbc4-46f8-881f-91708be07e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Flow 'volume_create_manager' (955ec28a-1030-4a35-a6ea-127466bb456e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:35:02 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-17b286ea-af7a-46dc-98f4-f1f6a464d27e tempest-TestServerVolumeAttachmentScenario-2129351812 None] Created volume successfully. Sep 30 10:35:12 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=30,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:35:12 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=36,cinder:UPDATE=39,cinder:DELETE=5,cinder:INSERT=7 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:35:14 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Flow 'volume_create_manager' (db81ea91-6e09-4579-9355-9395b30eabb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58e215d-a2c0-4c54-a0da-1d1717ed723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58e215d-a2c0-4c54-a0da-1d1717ed723f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-621954855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa19098-cc39-49c4-b0eb-6172344ebafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a5be6671334ce9962173daac7597ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:35:15Z,use_quota=True,user_id='68295af8d7164922bca8ec170569f2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c707f237-a91d-4517-842d-22821878afac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c707f237-a91d-4517-842d-22821878afac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a848f426-e163-41c7-a74b-6eaa83a2ce5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a848f426-e163-41c7-a74b-6eaa83a2ce5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa19098-cc39-49c4-b0eb-6172344ebafd', 'volume_name': 'volume-efa19098-cc39-49c4-b0eb-6172344ebafd', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1205dba-89fa-4f4f-ad97-e9939b88828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1205dba-89fa-4f4f-ad97-e9939b88828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a737f5e-886d-4aae-b015-40b22ab09d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:15 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Volume efa19098-cc39-49c4-b0eb-6172344ebafd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa19098-cc39-49c4-b0eb-6172344ebafd', 'volume_size': 1} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-621954855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa19098-cc39-49c4-b0eb-6172344ebafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a5be6671334ce9962173daac7597ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:35:15Z,use_quota=True,user_id='68295af8d7164922bca8ec170569f2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Creating volume efa19098-cc39-49c4-b0eb-6172344ebafd {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:35:15 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:35:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:15 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd 1073741824 Sep 30 10:35:15 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:16 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd 1073741824" returned: 0 in 1.039s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:16 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd Sep 30 10:35:16 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:16 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd" returned: 0 in 0.402s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:35:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a737f5e-886d-4aae-b015-40b22ab09d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa19098-cc39-49c4-b0eb-6172344ebafd', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1a6c19-685c-44a9-a9e0-8695da9d6570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:16 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Volume volume-efa19098-cc39-49c4-b0eb-6172344ebafd (efa19098-cc39-49c4-b0eb-6172344ebafd): created successfully Sep 30 10:35:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1a6c19-685c-44a9-a9e0-8695da9d6570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Flow 'volume_create_manager' (db81ea91-6e09-4579-9355-9395b30eabb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:35:16 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d2e68f06-c14b-45a0-9a5f-1929bc2daf51 tempest-AbsoluteLimitsTests-739160205 None] Created volume successfully. Sep 30 10:35:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Acquiring lock "cinder-efa19098-cc39-49c4-b0eb-6172344ebafd-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Lock "cinder-efa19098-cc39-49c4-b0eb-6172344ebafd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Acquiring lock "cinder-quobyte-efa19098-cc39-49c4-b0eb-6172344ebafd" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Lock "cinder-quobyte-efa19098-cc39-49c4-b0eb-6172344ebafd" acquired by "delete_volume" :: waited 0.045s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:18 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8478ccc5-911f-4707-93b4-4d15b777e94d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:35:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:18 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd Sep 30 10:35:18 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:19 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd" returned: 0 in 0.578s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:19 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd Sep 30 10:35:19 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:19 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-efa19098-cc39-49c4-b0eb-6172344ebafd" returned: 0 in 0.477s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Lock "cinder-quobyte-efa19098-cc39-49c4-b0eb-6172344ebafd" released by "delete_volume" :: held 1.170s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:35:20 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Created reservations ['acef4579-d6b2-4479-8153-8c01ac78b7c4', 'd4914264-b31c-4dce-84b2-f680d494cee6', '1de7952a-c601-4ac0-87ad-58aa48f2a27a', '13038dc1-5787-4656-9d4a-65ac84392a9f'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:35:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:35:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:35:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:20 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:35:20 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:20 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.379s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:20 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:35:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Deleted volume successfully. Sep 30 10:35:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8a67def4-ae16-4811-aa79-3d384e6f17aa tempest-AbsoluteLimitsTests-739160205 None] Lock "cinder-efa19098-cc39-49c4-b0eb-6172344ebafd-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Flow 'volume_create_manager' (295ade57-ab0a-4a23-9f44-b03407fb4868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878d1ee3-ea98-479b-980c-7179e29376b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878d1ee3-ea98-479b-980c-7179e29376b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-582692516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21768bbb-ccbe-4ed0-a468-5aaeedae8c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4eb54a88cd647e3b2065d2c2ca4cadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:35:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:35:28Z,use_quota=True,user_id='a8061adecf6c437fa0a03c1ed7385608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d7b9e4-5e06-4a35-a377-d05b16bb183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d7b9e4-5e06-4a35-a377-d05b16bb183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15035caa-b028-43cb-9ec5-e68b5a1cebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15035caa-b028-43cb-9ec5-e68b5a1cebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21768bbb-ccbe-4ed0-a468-5aaeedae8c7c', 'volume_name': 'volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c', 'volume_size': 2}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12de940c-3d08-43a7-84f7-e910522971e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12de940c-3d08-43a7-84f7-e910522971e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef303baa-3768-4d4e-9f97-7cb4d77f5966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:28 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Volume 21768bbb-ccbe-4ed0-a468-5aaeedae8c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c', 'volume_size': 2} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-582692516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21768bbb-ccbe-4ed0-a468-5aaeedae8c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4eb54a88cd647e3b2065d2c2ca4cadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:35:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:35:28Z,use_quota=True,user_id='a8061adecf6c437fa0a03c1ed7385608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Creating volume 21768bbb-ccbe-4ed0-a468-5aaeedae8c7c {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:35:28 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c 2147483648 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:28 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c 2147483648 Sep 30 10:35:28 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:28 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c 2147483648" returned: 0 in 0.603s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:28 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c Sep 30 10:35:28 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:29 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c" returned: 0 in 0.341s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:35:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef303baa-3768-4d4e-9f97-7cb4d77f5966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c', 'volume_size': 2}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c6f938-4a87-4ef7-9df8-f58d7a8db00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:29 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Volume volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c (21768bbb-ccbe-4ed0-a468-5aaeedae8c7c): created successfully Sep 30 10:35:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c6f938-4a87-4ef7-9df8-f58d7a8db00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Flow 'volume_create_manager' (295ade57-ab0a-4a23-9f44-b03407fb4868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:35:29 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d8ce4204-3422-400b-a779-1f8196c29655 tempest-VolumesCloneNegativeTest-1881635314 None] Created volume successfully. Sep 30 10:35:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Acquiring lock "cinder-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Lock "cinder-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Acquiring lock "cinder-quobyte-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Lock "cinder-quobyte-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c" acquired by "delete_volume" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:30 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[42be2fc5-f016-4691-8edb-58b6941538d9]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:35:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:30 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c Sep 30 10:35:30 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:31 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c" returned: 0 in 0.640s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:31 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c Sep 30 10:35:31 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:31 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c" returned: 0 in 0.591s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Lock "cinder-quobyte-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c" released by "delete_volume" :: held 1.327s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:35:31 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Created reservations ['196fad26-e3d4-4fb0-87fe-3a335f5ea5cc', 'adafd3ed-3611-437d-9b5d-58516c3275e6', '3950befb-1cab-4162-9497-ff456d2f7574', 'ca112faa-702d-4ef9-a8ba-fadf252f59de'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:35:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:35:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:35:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:32 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:35:32 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:32 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.320s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:32 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:35:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Deleted volume successfully. Sep 30 10:35:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b2f81387-3691-490e-a87f-24b41ff21d51 tempest-VolumesCloneNegativeTest-1881635314 None] Lock "cinder-21768bbb-ccbe-4ed0-a468-5aaeedae8c7c-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:37 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:35:37 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:37 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.343s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:35:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d7170058-d096-40f1-9688-e24241aef889 req-3c98666c-5982-458e-a518-b413eafc5b6a tempest-TestStampPattern-1955448536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d7170058-d096-40f1-9688-e24241aef889 req-3c98666c-5982-458e-a518-b413eafc5b6a tempest-TestStampPattern-1955448536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-d7170058-d096-40f1-9688-e24241aef889 req-3c98666c-5982-458e-a518-b413eafc5b6a tempest-TestStampPattern-1955448536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-d7170058-d096-40f1-9688-e24241aef889 req-3c98666c-5982-458e-a518-b413eafc5b6a tempest-TestStampPattern-1955448536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03f5cfc7-dc25-41b0-ab4b-5edf8316f7fd', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-ba37d5e9-7c46-4d2b-b473-2924b7f9ac0f req-94431742-2742-4e93-9f3e-4ec547d55194 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-ba37d5e9-7c46-4d2b-b473-2924b7f9ac0f req-94431742-2742-4e93-9f3e-4ec547d55194 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-ba37d5e9-7c46-4d2b-b473-2924b7f9ac0f req-94431742-2742-4e93-9f3e-4ec547d55194 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Flow 'volume_create_manager' (eccaa473-ee4a-4b5f-b07b-d56969763a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d65d9be-063a-4e40-8cc9-3fa0627fafba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-d7170058-d096-40f1-9688-e24241aef889 req-3c98666c-5982-458e-a518-b413eafc5b6a tempest-TestStampPattern-1955448536 None] attachment_update completed successfully. Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d65d9be-063a-4e40-8cc9-3fa0627fafba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-874877561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24adf8a-1d42-4acb-925b-0b7517833315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4af540ca3e4523b450a947a1729353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:35:39Z,use_quota=True,user_id='b98a0cbc6c9243c4bcdbb69dc036986a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7d0596-f96a-447e-b806-bcdee332fa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7d0596-f96a-447e-b806-bcdee332fa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa7752c-09ce-4a9e-90dd-6491e208b6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa7752c-09ce-4a9e-90dd-6491e208b6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24adf8a-1d42-4acb-925b-0b7517833315', 'volume_name': 'volume-c24adf8a-1d42-4acb-925b-0b7517833315', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676ef4c1-35e0-43aa-9251-ac8849fb6776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676ef4c1-35e0-43aa-9251-ac8849fb6776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5913314d-910a-4f2c-83ce-03121f19c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:38 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Volume c24adf8a-1d42-4acb-925b-0b7517833315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24adf8a-1d42-4acb-925b-0b7517833315', 'volume_size': 1} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-874877561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24adf8a-1d42-4acb-925b-0b7517833315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4af540ca3e4523b450a947a1729353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:35:39Z,use_quota=True,user_id='b98a0cbc6c9243c4bcdbb69dc036986a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Creating volume c24adf8a-1d42-4acb-925b-0b7517833315 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:35:38 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-ba37d5e9-7c46-4d2b-b473-2924b7f9ac0f req-94431742-2742-4e93-9f3e-4ec547d55194 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-3ba8dcac-d861-488a-997e-4b38fad454ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c457db88-8855-4954-afb3-7badcf412344', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:35:38 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315 1073741824 Sep 30 10:35:38 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-ba37d5e9-7c46-4d2b-b473-2924b7f9ac0f req-94431742-2742-4e93-9f3e-4ec547d55194 tempest-TestServerVolumeAttachmentScenario-2129351812 None] attachment_update completed successfully. Sep 30 10:35:39 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315 1073741824" returned: 0 in 0.568s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:39 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315 Sep 30 10:35:39 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:39 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315" returned: 0 in 0.414s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:35:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5913314d-910a-4f2c-83ce-03121f19c577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24adf8a-1d42-4acb-925b-0b7517833315', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aaf2a36-9b10-46c1-9732-67c8e920de05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:39 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Volume volume-c24adf8a-1d42-4acb-925b-0b7517833315 (c24adf8a-1d42-4acb-925b-0b7517833315): created successfully Sep 30 10:35:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aaf2a36-9b10-46c1-9732-67c8e920de05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Flow 'volume_create_manager' (eccaa473-ee4a-4b5f-b07b-d56969763a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:35:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8748288c-bc16-4b9f-9657-dd845328cfd8 tempest-VolumesNegativeTest-846753739 None] Created volume successfully. Sep 30 10:35:42 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-74a9994c-e094-4405-a8a0-4953279480e2 req-3634b656-8d3f-411c-bdf5-fbb39da1282e tempest-TestStampPattern-1955448536 None] Terminate volume connection completed successfully. Sep 30 10:35:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-74a9994c-e094-4405-a8a0-4953279480e2 req-3634b656-8d3f-411c-bdf5-fbb39da1282e tempest-TestStampPattern-1955448536 None] Deleting attachment 03f5cfc7-dc25-41b0-ab4b-5edf8316f7fd. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:35:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-bee11d0f-4e51-4598-87e7-7ed58ef109a3 req-fd8436fc-73c7-4012-b2aa-2ac91e6f5add tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-bee11d0f-4e51-4598-87e7-7ed58ef109a3 req-fd8436fc-73c7-4012-b2aa-2ac91e6f5add tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-bee11d0f-4e51-4598-87e7-7ed58ef109a3 req-fd8436fc-73c7-4012-b2aa-2ac91e6f5add tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-bee11d0f-4e51-4598-87e7-7ed58ef109a3 req-fd8436fc-73c7-4012-b2aa-2ac91e6f5add tempest-TestServerVolumeAttachmentScenario-2129351812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70d0539a-cee8-4209-b2c9-18c723558055', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:35:46 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-bee11d0f-4e51-4598-87e7-7ed58ef109a3 req-fd8436fc-73c7-4012-b2aa-2ac91e6f5add tempest-TestServerVolumeAttachmentScenario-2129351812 None] attachment_update completed successfully. Sep 30 10:35:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Acquiring lock "cinder-edfaa87d-64d4-499f-98e5-7e9d8a5fb063-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Lock "cinder-edfaa87d-64d4-499f-98e5-7e9d8a5fb063-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Acquiring lock "cinder-quobyte-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:49 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae290fa-2df7-4d6a-9b09-314012588f29]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:35:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:49 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 Sep 30 10:35:49 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:49 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-143fdf6b-763d-4b1e-a826-8debd84f9b58 req-601035c7-e201-4eeb-ad08-00fb62725307 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Terminate volume connection completed successfully. Sep 30 10:35:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-143fdf6b-763d-4b1e-a826-8debd84f9b58 req-601035c7-e201-4eeb-ad08-00fb62725307 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Deleting attachment 70d0539a-cee8-4209-b2c9-18c723558055. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:35:49 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" returned: 0 in 0.676s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:49 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063 Sep 30 10:35:49 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:50 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" returned: 0 in 0.360s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-edfaa87d-64d4-499f-98e5-7e9d8a5fb063" released by "delete_volume" :: held 1.115s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Created reservations ['f45e396c-e494-4687-9511-5bc73037810b', '956de177-1df5-4584-baa8-861a7144c435', 'a52dc4c9-a1cd-43e3-b10d-64b3de0992e3', '7cf33b10-2e34-405b-8327-6771f8d730cd'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:50 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:35:50 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:50 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.420s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:35:50 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Deleted volume successfully. Sep 30 10:35:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3434881e-1989-4dc8-926e-63427caeb8a3 tempest-TestStampPattern-1955448536 None] Lock "cinder-edfaa87d-64d4-499f-98e5-7e9d8a5fb063-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:35:51 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-9ebcf5ab-17cb-4356-a702-faaa29db338f req-ef404088-9313-46b4-b2c0-eb2fad2e98c1 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Terminate volume connection completed successfully. Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-9ebcf5ab-17cb-4356-a702-faaa29db338f req-ef404088-9313-46b4-b2c0-eb2fad2e98c1 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Deleting attachment c457db88-8855-4954-afb3-7badcf412344. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Acquiring lock "cinder-08f15853-2500-45c7-936a-d71db3ed8891-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Lock "cinder-08f15853-2500-45c7-936a-d71db3ed8891-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Acquiring lock "cinder-quobyte-ec9e6f04-9013-430c-a124-289a23c5d1bd" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-ec9e6f04-9013-430c-a124-289a23c5d1bd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Acquiring lock "cinder-quobyte-08f15853-2500-45c7-936a-d71db3ed8891" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-08f15853-2500-45c7-936a-d71db3ed8891" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Deleting offline snapshot 08f15853-2500-45c7-936a-d71db3ed8891 of volume ec9e6f04-9013-430c-a124-289a23c5d1bd {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] snapshot_file for this snap is: volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d9969c-2b03-40bf-a732-c4480224e19b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:35:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:51 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 Sep 30 10:35:51 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:52 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891" returned: 0 in 0.647s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec9e6f04-9013-430c-a124-289a23c5d1bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:35:52 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf1600f-c75e-4662-b1b1-e171cc1a0b41]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:35:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:52 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd Sep 30 10:35:52 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:53 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd" returned: 0 in 0.987s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:53 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 Sep 30 10:35:53 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:54 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891" returned: 0 in 0.777s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:54 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891 Sep 30 10:35:54 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:54 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd.08f15853-2500-45c7-936a-d71db3ed8891" returned: 0 in 0.662s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-08f15853-2500-45c7-936a-d71db3ed8891" released by "_delete_snapshot" :: held 3.255s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:35:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-ec9e6f04-9013-430c-a124-289a23c5d1bd" released by "delete_snapshot" :: held 3.287s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:35:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Created reservations ['956d4d81-9cf9-4543-ab27-887cffc6eb3c', '14deaa8c-a0b3-421a-a5f9-ad2421d6b67a', '9a4893f8-6147-49de-94eb-43e9ea7d5507', '4f362a15-9edd-4e15-a98a-b0fda5374189'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:35:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Delete snapshot completed successfully. Sep 30 10:35:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-16e1e118-f20b-463f-8604-651fccbe93af tempest-TestStampPattern-1955448536 None] Lock "cinder-08f15853-2500-45c7-936a-d71db3ed8891-delete_snapshot" released by "delete_snapshot" :: held 3.580s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Flow 'volume_create_manager' (70a80012-bb59-4116-a644-9e112bfe4cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfedb57-20be-479e-bf77-d9c21ae040bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfedb57-20be-479e-bf77-d9c21ae040bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-413952321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876f525f6b11478494f150c19c3e347d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:35:58Z,use_quota=True,user_id='fb2c7c4a25524ebcb88e47994702a28c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540be6ab-0089-405a-8f0e-505543f13f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540be6ab-0089-405a-8f0e-505543f13f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd3d743-8bb1-4810-9b51-21177ba26ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd3d743-8bb1-4810-9b51-21177ba26ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b', 'volume_name': 'volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852ef568-3e8b-4eb2-8171-5c4b0bb92ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852ef568-3e8b-4eb2-8171-5c4b0bb92ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430121b6-807e-41ea-9434-9932aad51771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:58 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Volume 5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b', 'volume_size': 1} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-413952321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876f525f6b11478494f150c19c3e347d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:35:58Z,use_quota=True,user_id='fb2c7c4a25524ebcb88e47994702a28c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Creating volume 5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:35:58 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:35:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:58 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b 1073741824 Sep 30 10:35:58 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:59 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b 1073741824" returned: 0 in 0.650s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:59 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b Sep 30 10:35:59 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "cinder-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "cinder-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "cinder-quobyte-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:35:59 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "cinder-quobyte-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891" acquired by "delete_volume" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b" returned: 0 in 0.375s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430121b6-807e-41ea-9434-9932aad51771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4f0125-ff86-4149-95b6-62798ab6127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ca706b-aca1-44df-8e21-0fc41289139f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:35:59 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Volume volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b (5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b): created successfully Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4f0125-ff86-4149-95b6-62798ab6127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:35:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Flow 'volume_create_manager' (70a80012-bb59-4116-a644-9e112bfe4cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:35:59 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0f3f2902-f073-43fb-af8d-eea1197e2fd1 tempest-AttachVolumeShelveTestJSON-1086713640 None] Created volume successfully. Sep 30 10:35:59 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 Sep 30 10:35:59 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:00 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891" returned: 0 in 0.458s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:00 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891 Sep 30 10:36:00 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:00 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891" returned: 0 in 0.272s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "cinder-quobyte-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891" released by "delete_volume" :: held 0.814s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Acquiring lock "cinder-ec9e6f04-9013-430c-a124-289a23c5d1bd-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Lock "cinder-ec9e6f04-9013-430c-a124-289a23c5d1bd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Created reservations ['ed4acda6-3cb7-4255-970c-a304aaa4977f', 'c3f4f977-6dfe-4546-8c92-c9b40716b8b8', '6de3205e-b657-4079-9443-57321ead9164', '5b852575-48e1-4c5e-82d4-cb82bf68aa99'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Acquiring lock "cinder-quobyte-ec9e6f04-9013-430c-a124-289a23c5d1bd" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-ec9e6f04-9013-430c-a124-289a23c5d1bd" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c24d60c-d131-4471-9620-807c2eb64e49]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:00 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:00 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:00 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd Sep 30 10:36:00 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:00 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.285s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Deleted volume successfully. Sep 30 10:36:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6fa890bf-cf5a-404e-b1cb-9c9f303af8d6 tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "cinder-6ca4eeb2-5a6e-4ae0-882b-66a9a6562891-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:01 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd" returned: 0 in 0.502s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:01 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd Sep 30 10:36:01 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:01 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ec9e6f04-9013-430c-a124-289a23c5d1bd" returned: 0 in 0.301s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Lock "cinder-quobyte-ec9e6f04-9013-430c-a124-289a23c5d1bd" released by "delete_volume" :: held 0.890s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Created reservations ['892e3481-204e-4201-82e0-0507ac0669f4', '89070cbf-d560-4941-a7b5-cdb9a182d96b', '144025e2-b286-4184-aa96-04992da3e9d5', '9fc29972-377a-4c03-858e-7901c8030b4c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:01 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:01 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "cinder-3ba8dcac-d861-488a-997e-4b38fad454ae-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "cinder-3ba8dcac-d861-488a-997e-4b38fad454ae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "cinder-quobyte-3ba8dcac-d861-488a-997e-4b38fad454ae" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "cinder-quobyte-3ba8dcac-d861-488a-997e-4b38fad454ae" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5975e7-37d1-4a66-8a87-a024bfa4bb29]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:02 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.450s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:02 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae Sep 30 10:36:02 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:02 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:02 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Deleted volume successfully. Sep 30 10:36:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d410d1e2-1f1f-4367-b8ee-2322ec1927b1 tempest-TestStampPattern-1955448536 None] Lock "cinder-ec9e6f04-9013-430c-a124-289a23c5d1bd-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:02 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae" returned: 0 in 0.622s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:02 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae Sep 30 10:36:02 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:02 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ba8dcac-d861-488a-997e-4b38fad454ae" returned: 0 in 0.327s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "cinder-quobyte-3ba8dcac-d861-488a-997e-4b38fad454ae" released by "delete_volume" :: held 1.034s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:02 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Created reservations ['6e700439-1c21-4c46-b01d-b8085761e619', '5deeb4d9-9a8a-4f46-9035-8c4090a2645f', 'c9d357d1-bc25-4098-8cc7-0c1cc9f255fe', 'd9dc14e6-9b2a-4922-8857-7b388165b68e'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:03 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:03 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:03 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.395s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:03 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:03 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Deleted volume successfully. Sep 30 10:36:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9d189821-935f-4dae-a27a-248edf6edeed tempest-TestServerVolumeAttachmentScenario-2129351812 None] Lock "cinder-3ba8dcac-d861-488a-997e-4b38fad454ae-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Acquiring lock "cinder-c24adf8a-1d42-4acb-925b-0b7517833315-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Lock "cinder-c24adf8a-1d42-4acb-925b-0b7517833315-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Acquiring lock "cinder-quobyte-c24adf8a-1d42-4acb-925b-0b7517833315" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Lock "cinder-quobyte-c24adf8a-1d42-4acb-925b-0b7517833315" acquired by "delete_volume" :: waited 0.042s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:07 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[20812b84-7c8d-48c6-978b-1f2c21ea8537]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:07 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315 Sep 30 10:36:07 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:08 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315" returned: 0 in 0.448s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:08 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315 Sep 30 10:36:08 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:08 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c24adf8a-1d42-4acb-925b-0b7517833315" returned: 0 in 0.252s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Lock "cinder-quobyte-c24adf8a-1d42-4acb-925b-0b7517833315" released by "delete_volume" :: held 0.769s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Created reservations ['b9f01301-d749-4aff-9d1b-8a41e50f5c85', '12ad538c-ca8a-43dd-bbb8-0bcf553a66dd', '57b612eb-abb4-410d-88e4-8f89686207c2', 'e024c756-0a8b-4838-94c1-968afc446cfe'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:08 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:08 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:08 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.335s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:08 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Deleted volume successfully. Sep 30 10:36:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b1449ec9-a081-40fb-977c-2566caaae2ff tempest-VolumesNegativeTest-846753739 None] Lock "cinder-c24adf8a-1d42-4acb-925b-0b7517833315-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:18 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=75,cinder:UPDATE=74,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:36:18 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=82,cinder:SELECT=67,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:36:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-e1c7b393-cd02-4278-8f9c-98b9ed7b21d8 req-b68b8358-0331-4a8f-89c8-10abb10711a5 tempest-AttachVolumeShelveTestJSON-1086713640 None] No connector for attachment 1c977c0f-0437-4bd0-83dd-bc64b2a6f2de; skipping storage backend terminate_connection call. {{(pid=87013) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 30 10:36:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-e1c7b393-cd02-4278-8f9c-98b9ed7b21d8 req-b68b8358-0331-4a8f-89c8-10abb10711a5 tempest-AttachVolumeShelveTestJSON-1086713640 None] Deleting attachment 1c977c0f-0437-4bd0-83dd-bc64b2a6f2de. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (9d6e78ad-5aa9-42c5-a01e-45de5a40fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca701c1f-9873-4206-8a6f-14250cbf4362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca701c1f-9873-4206-8a6f-14250cbf4362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1266749993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf320441-3418-4e4b-8398-45a20403efcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:22Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d637b8-9242-4141-8aa5-f1b1a44c9448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d637b8-9242-4141-8aa5-f1b1a44c9448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bac364-d743-453a-b349-7b4bef2de0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bac364-d743-453a-b349-7b4bef2de0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf320441-3418-4e4b-8398-45a20403efcb', 'volume_name': 'volume-cf320441-3418-4e4b-8398-45a20403efcb', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4961bc83-c66a-4015-8b53-6ca0d005f723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4961bc83-c66a-4015-8b53-6ca0d005f723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb60a248-b153-4fda-af85-1cee50e7f50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:22 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume cf320441-3418-4e4b-8398-45a20403efcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf320441-3418-4e4b-8398-45a20403efcb', 'volume_size': 1} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1266749993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf320441-3418-4e4b-8398-45a20403efcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:22Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Creating volume cf320441-3418-4e4b-8398-45a20403efcb {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:36:22 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:36:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:22 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb 1073741824 Sep 30 10:36:22 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:23 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb 1073741824" returned: 0 in 0.653s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:23 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb Sep 30 10:36:23 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:23 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb" returned: 0 in 0.380s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:36:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb60a248-b153-4fda-af85-1cee50e7f50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf320441-3418-4e4b-8398-45a20403efcb', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6d77e2-39b5-43db-9a4a-3223602fe53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:23 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume volume-cf320441-3418-4e4b-8398-45a20403efcb (cf320441-3418-4e4b-8398-45a20403efcb): created successfully Sep 30 10:36:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6d77e2-39b5-43db-9a4a-3223602fe53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (9d6e78ad-5aa9-42c5-a01e-45de5a40fb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:23 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-929252ae-37a5-462c-bd09-825d1b13eef4 tempest-CreateVolumesFromSnapshotTest-814930497 None] Created volume successfully. Sep 30 10:36:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Creating offline snapshot e26fd728-4ba8-4902-8bd3-f9b5527daffa of volume cf320441-3418-4e4b-8398-45a20403efcb {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:36:24 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac60c58-bb5f-4ed7-a982-3e5ef064d0e8]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:24 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb Sep 30 10:36:24 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:25 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb" returned: 0 in 0.611s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:25 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa 1G Sep 30 10:36:25 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Flow 'volume_create_manager' (b0a223c0-ce38-4a0b-973c-a1cf4152c4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4de52d-2614-4f57-9d45-9cd6a347cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4de52d-2614-4f57-9d45-9cd6a347cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1693385225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55703381-5c11-4d3c-a67f-cb404bb8f767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338cf0f7033047e6bee02161dc2bbd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:26Z,use_quota=True,user_id='e13c14f4751b471c8ac8c164e2be7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ebdf5c-24ad-44ad-b906-05dbe9754cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ebdf5c-24ad-44ad-b906-05dbe9754cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ad1131-6b95-47c6-8299-44560b574937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ad1131-6b95-47c6-8299-44560b574937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55703381-5c11-4d3c-a67f-cb404bb8f767', 'volume_name': 'volume-55703381-5c11-4d3c-a67f-cb404bb8f767', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c1b387-9d59-4d41-82fc-372a4e8a3969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c1b387-9d59-4d41-82fc-372a4e8a3969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63660080-f3e9-49b5-9a59-078fd279fd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:25 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Volume 55703381-5c11-4d3c-a67f-cb404bb8f767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55703381-5c11-4d3c-a67f-cb404bb8f767', 'volume_size': 1} Sep 30 10:36:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:26 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa 1G" returned: 0 in 0.823s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf320441-3418-4e4b-8398-45a20403efcb -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:26 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf320441-3418-4e4b-8398-45a20403efcb -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa Sep 30 10:36:26 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:26 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf320441-3418-4e4b-8398-45a20403efcb -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa" returned: 0 in 0.504s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:26 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa is being set with open permissions: ugo+rw Sep 30 10:36:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:26 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa Sep 30 10:36:26 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:27 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa" returned: 0 in 0.398s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:27 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.info Sep 30 10:36:27 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:27 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.info" returned: 0 in 0.423s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:27 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.info is being set with open permissions: ugo+rw Sep 30 10:36:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:27 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.info Sep 30 10:36:27 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:27 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.info" returned: 0 in 0.375s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.269s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.162s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1693385225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55703381-5c11-4d3c-a67f-cb404bb8f767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338cf0f7033047e6bee02161dc2bbd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:26Z,use_quota=True,user_id='e13c14f4751b471c8ac8c164e2be7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Creating volume 55703381-5c11-4d3c-a67f-cb404bb8f767 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:36:28 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:28 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 1073741824 Sep 30 10:36:28 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:28 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0aa83d4d-5e9a-41ac-bb78-0ab0c35e294f tempest-CreateVolumesFromSnapshotTest-814930497 None] Create snapshot completed successfully Sep 30 10:36:28 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 1073741824" returned: 0 in 0.552s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:28 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 Sep 30 10:36:28 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:28 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767" returned: 0 in 0.283s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63660080-f3e9-49b5-9a59-078fd279fd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55703381-5c11-4d3c-a67f-cb404bb8f767', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0afb27-3705-44dd-81d0-b51650aa342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:28 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Volume volume-55703381-5c11-4d3c-a67f-cb404bb8f767 (55703381-5c11-4d3c-a67f-cb404bb8f767): created successfully Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0afb27-3705-44dd-81d0-b51650aa342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:28 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Flow 'volume_create_manager' (b0a223c0-ce38-4a0b-973c-a1cf4152c4dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:28 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a6c60af4-b5e1-479e-921f-dad06fca9d65 tempest-VolumesSnapshotTestJSON-278545747 None] Created volume successfully. Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (efe0779b-2aba-4fa2-9b65-68ce03cc314e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77660caa-59db-4871-b94a-b76fa2e3ff90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77660caa-59db-4871-b94a-b76fa2e3ff90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733646217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50b92d6-0228-459a-9766-163d65d45a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:29Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb31c85-02bb-45a2-8c33-3506aedd7346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb31c85-02bb-45a2-8c33-3506aedd7346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247b1e37-62a9-4137-97b2-892b76683222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247b1e37-62a9-4137-97b2-892b76683222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50b92d6-0228-459a-9766-163d65d45a9c', 'volume_name': 'volume-d50b92d6-0228-459a-9766-163d65d45a9c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2117aece-39e1-4adb-828e-8bcb9b59322a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2117aece-39e1-4adb-828e-8bcb9b59322a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84098f5-0c1c-4e32-9ead-1c3845887fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:29 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume d50b92d6-0228-459a-9766-163d65d45a9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50b92d6-0228-459a-9766-163d65d45a9c', 'volume_size': 1} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733646217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50b92d6-0228-459a-9766-163d65d45a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:29Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Creating volume d50b92d6-0228-459a-9766-163d65d45a9c {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:36:29 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:36:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:29 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c 1073741824 Sep 30 10:36:29 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (9ac85e7b-5e26-479c-ba3b-dbf8281f85aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc49ba3b-57b0-40fe-9da7-bed333341d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc49ba3b-57b0-40fe-9da7-bed333341d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-544804928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:30Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3663f8e1-87a8-491e-9a48-da866ac15bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3663f8e1-87a8-491e-9a48-da866ac15bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad441f94-cbce-4e23-9758-7e1ca20f668a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad441f94-cbce-4e23-9758-7e1ca20f668a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da', 'volume_name': 'volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc06d6c-b7c2-4799-994b-ee1693396bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc06d6c-b7c2-4799-994b-ee1693396bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d0e114-8896-4f24-91fb-c01ef4ce1c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:30 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume 1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da', 'volume_size': 1} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:30 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c 1073741824" returned: 0 in 0.823s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:30 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c Sep 30 10:36:30 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:30 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (1eeac207-efeb-48be-a175-ea4cf4ae64bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a11071-b0ec-41ed-96a8-c9ae22f907f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c" returned: 0 in 0.397s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-544804928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:30Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Creating volume 1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:36:30 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:36:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a11071-b0ec-41ed-96a8-c9ae22f907f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-716122055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:31Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a355e66-a0a3-4c11-b8b9-16a1cd71553d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:31 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da 1073741824 Sep 30 10:36:31 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a355e66-a0a3-4c11-b8b9-16a1cd71553d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0ae831-fdbb-4d4f-9a20-dd5b4cd77253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0ae831-fdbb-4d4f-9a20-dd5b4cd77253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9', 'volume_name': 'volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810c2a4f-4f61-4274-acb6-59738e1ca748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810c2a4f-4f61-4274-acb6-59738e1ca748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c34960-0b82-4742-b2c5-aa4fa1c543a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9', 'volume_size': 1} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84098f5-0c1c-4e32-9ead-1c3845887fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50b92d6-0228-459a-9766-163d65d45a9c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b814ac-426f-425b-8fa7-277c33b4be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume volume-d50b92d6-0228-459a-9766-163d65d45a9c (d50b92d6-0228-459a-9766-163d65d45a9c): created successfully Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b814ac-426f-425b-8fa7-277c33b4be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (efe0779b-2aba-4fa2-9b65-68ce03cc314e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-417fde20-1568-48cc-9e7d-a26f3d130d23 tempest-CreateVolumesFromSnapshotTest-814930497 None] Created volume successfully. Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (b301bddc-7094-4f41-aeb2-e2f3ecbe7bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000aa47f-847c-4f03-861e-fc5c087e568c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000aa47f-847c-4f03-861e-fc5c087e568c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-450219029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fdb73e-eb09-4c50-bf33-98e1ea01f839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:31Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7fe35b-0cae-4b5b-88de-d43970c91e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7fe35b-0cae-4b5b-88de-d43970c91e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4444f2d-f809-47a0-a73a-46f356e5396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4444f2d-f809-47a0-a73a-46f356e5396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57fdb73e-eb09-4c50-bf33-98e1ea01f839', 'volume_name': 'volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d760bb-8305-4bb7-9e13-2629a9d415c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d760bb-8305-4bb7-9e13-2629a9d415c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915795e4-9697-4263-a828-b8efafdb1737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume 57fdb73e-eb09-4c50-bf33-98e1ea01f839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839', 'volume_size': 1} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:31 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da 1073741824" returned: 0 in 0.770s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:31 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da Sep 30 10:36:31 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (404585f5-0dbe-4c33-91db-0320134d9eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cdef11-2682-4bbc-ad51-701bc5b2006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:32 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cdef11-2682-4bbc-ad51-701bc5b2006b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723488497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd479b49-29f7-4067-8e14-60ab723fdd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:32Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ae2db4-335f-421c-8084-d7392a4aee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ae2db4-335f-421c-8084-d7392a4aee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40016c4-522e-4b59-8ffb-b1afcb731ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40016c4-522e-4b59-8ffb-b1afcb731ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd479b49-29f7-4067-8e14-60ab723fdd18', 'volume_name': 'volume-bd479b49-29f7-4067-8e14-60ab723fdd18', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b801fd1-e8e0-4532-94f9-88273130e8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b801fd1-e8e0-4532-94f9-88273130e8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35da4e96-1e30-42c7-afde-fcc3504b66c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume bd479b49-29f7-4067-8e14-60ab723fdd18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd479b49-29f7-4067-8e14-60ab723fdd18', 'volume_size': 1} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da" returned: 0 in 0.621s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.673s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d0e114-8896-4f24-91fb-c01ef4ce1c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cd4d14-0ccf-40a8-89c1-f63a982e1d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Creating offline snapshot 8e50b0da-ea43-4435-b116-f425e8d0768b of volume 55703381-5c11-4d3c-a67f-cb404bb8f767 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:36:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da (1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da): created successfully Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cd4d14-0ccf-40a8-89c1-f63a982e1d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (9ac85e7b-5e26-479c-ba3b-dbf8281f85aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8893bc9f-89a0-4e37-be32-7fc32c5f1e2e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-12b2ada6-360b-4803-ace3-85eb6c848a33 tempest-CreateVolumesFromSnapshotTest-814930497 None] Created volume successfully. Sep 30 10:36:32 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 Sep 30 10:36:32 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:33 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767" returned: 0 in 0.705s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:33 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b 1G Sep 30 10:36:33 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:33 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b 1G" returned: 0 in 0.653s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55703381-5c11-4d3c-a67f-cb404bb8f767 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:33 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55703381-5c11-4d3c-a67f-cb404bb8f767 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b Sep 30 10:36:33 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:34 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55703381-5c11-4d3c-a67f-cb404bb8f767 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b" returned: 0 in 0.408s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:34 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b is being set with open permissions: ugo+rw Sep 30 10:36:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:34 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b Sep 30 10:36:34 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:34 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b" returned: 0 in 0.338s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:34 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.info Sep 30 10:36:34 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:34 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.info" returned: 0 in 0.366s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:34 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.info is being set with open permissions: ugo+rw Sep 30 10:36:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:35 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.info Sep 30 10:36:35 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:35 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.info" returned: 0 in 0.310s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.274s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-716122055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:31Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Creating volume e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:36:35 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:36:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:35 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 1073741824 Sep 30 10:36:35 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-dae01383-979f-4ef6-8f77-7aa52eb90036 tempest-VolumesSnapshotTestJSON-278545747 None] Create snapshot completed successfully Sep 30 10:36:36 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 1073741824" returned: 0 in 0.755s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:36 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 Sep 30 10:36:36 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-8e50b0da-ea43-4435-b116-f425e8d0768b-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-8e50b0da-ea43-4435-b116-f425e8d0768b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-55703381-5c11-4d3c-a67f-cb404bb8f767" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-55703381-5c11-4d3c-a67f-cb404bb8f767" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-8e50b0da-ea43-4435-b116-f425e8d0768b" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-8e50b0da-ea43-4435-b116-f425e8d0768b" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Deleting offline snapshot 8e50b0da-ea43-4435-b116-f425e8d0768b of volume 55703381-5c11-4d3c-a67f-cb404bb8f767 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] snapshot_file for this snap is: volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c41028b-b116-453b-bcf1-850895b61f2f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:36 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9" returned: 0 in 0.644s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:36:36 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b Sep 30 10:36:36 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.090s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-450219029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fdb73e-eb09-4c50-bf33-98e1ea01f839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:31Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Creating volume 57fdb73e-eb09-4c50-bf33-98e1ea01f839 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:36:36 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c34960-0b82-4742-b2c5-aa4fa1c543a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41712b9a-e59e-4bdf-9b34-908e90dec151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:36 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839 1073741824 Sep 30 10:36:36 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:36 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 (e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9): created successfully Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41712b9a-e59e-4bdf-9b34-908e90dec151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (1eeac207-efeb-48be-a175-ea4cf4ae64bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:37 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-89f31087-c807-43b8-825e-3ded92f2599b tempest-CreateVolumesFromSnapshotTest-814930497 None] Created volume successfully. Sep 30 10:36:37 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:37 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:37 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b" returned: 0 in 0.898s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55703381-5c11-4d3c-a67f-cb404bb8f767(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe58daf9-0317-4877-960e-c0a9c6f73c81]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:37 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.462s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:36:37 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839 1073741824" returned: 0 in 0.852s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:37 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 Sep 30 10:36:37 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:37 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839 Sep 30 10:36:37 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:38 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839" returned: 0 in 0.441s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:36:38 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.817s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723488497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd479b49-29f7-4067-8e14-60ab723fdd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24989d5ffcf487f88bc1664807cbca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:32Z,use_quota=True,user_id='e76a606ac3b9492b8fc1b57fd5f0643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Creating volume bd479b49-29f7-4067-8e14-60ab723fdd18 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:36:38 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767" returned: 0 in 0.714s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:38 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18 1073741824 Sep 30 10:36:38 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915795e4-9697-4263-a828-b8efafdb1737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470ac6f2-a444-44f8-a566-2c7b14a093ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:38 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b Sep 30 10:36:38 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:38 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839 (57fdb73e-eb09-4c50-bf33-98e1ea01f839): created successfully Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470ac6f2-a444-44f8-a566-2c7b14a093ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (b301bddc-7094-4f41-aeb2-e2f3ecbe7bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7350fbc5-58df-4ae7-b17a-e8a771264854 tempest-CreateVolumesFromSnapshotTest-814930497 None] Created volume successfully. Sep 30 10:36:38 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b" returned: 0 in 0.526s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:38 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b Sep 30 10:36:38 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:38 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18 1073741824" returned: 0 in 0.755s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:39 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18 Sep 30 10:36:39 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:39 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767.8e50b0da-ea43-4435-b116-f425e8d0768b" returned: 0 in 0.465s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-8e50b0da-ea43-4435-b116-f425e8d0768b" released by "_delete_snapshot" :: held 2.878s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-55703381-5c11-4d3c-a67f-cb404bb8f767" released by "delete_snapshot" :: held 2.937s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:39 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18" returned: 0 in 0.335s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35da4e96-1e30-42c7-afde-fcc3504b66c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd479b49-29f7-4067-8e14-60ab723fdd18', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c170f3e-4c30-482a-a421-ca283729bda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:39 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Volume volume-bd479b49-29f7-4067-8e14-60ab723fdd18 (bd479b49-29f7-4067-8e14-60ab723fdd18): created successfully Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c170f3e-4c30-482a-a421-ca283729bda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Flow 'volume_create_manager' (404585f5-0dbe-4c33-91db-0320134d9eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-dd5460e1-f5fb-4c9a-b904-05b939a12822 tempest-CreateVolumesFromSnapshotTest-814930497 None] Created volume successfully. Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Created reservations ['778fe6b0-b2c3-47ce-bae6-2025af5865e2', 'a3743066-16cf-4293-b371-c5dda288fc44', 'f16df2b1-9cfa-480b-a0f7-7a8a51fc0f33', 'a2c1a956-23a5-4d05-bacb-13d3981b79ab'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Delete snapshot completed successfully. Sep 30 10:36:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceb48b95-4f6b-4753-b84f-0b8daa1d0893 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-8e50b0da-ea43-4435-b116-f425e8d0768b-delete_snapshot" released by "delete_snapshot" :: held 3.286s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-bd479b49-29f7-4067-8e14-60ab723fdd18-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-bd479b49-29f7-4067-8e14-60ab723fdd18-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-quobyte-bd479b49-29f7-4067-8e14-60ab723fdd18" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-bd479b49-29f7-4067-8e14-60ab723fdd18" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:40 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49b78b5-56e6-4fcd-8a45-7fa3d861cf87]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:40 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18 Sep 30 10:36:40 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:40 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18" returned: 0 in 0.437s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:40 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18 Sep 30 10:36:40 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:41 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bd479b49-29f7-4067-8e14-60ab723fdd18" returned: 0 in 0.518s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-bd479b49-29f7-4067-8e14-60ab723fdd18" released by "delete_volume" :: held 1.022s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Created reservations ['b23c838e-bd4a-475f-a666-b173025fe571', 'bd75b8c1-0656-4983-9cf9-993b18bbd68d', '21f62a43-6ec7-4d6a-80ce-cbcb86a5b446', '5fc6de4a-a059-4735-92e3-a5ae6fb700bb'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:41 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:41 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Flow 'volume_create_manager' (1cddd3c7-0457-4d47-9cc7-8c13f8fa0d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44e1a04-771d-410a-99e3-dec4f6a06cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44e1a04-771d-410a-99e3-dec4f6a06cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-63866241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bd5c06-23ad-42bf-b003-26e65dd413de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338cf0f7033047e6bee02161dc2bbd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:42Z,use_quota=True,user_id='e13c14f4751b471c8ac8c164e2be7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c33479c-6f3b-44bb-a136-38db7a19711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c33479c-6f3b-44bb-a136-38db7a19711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d55338a-51f6-43ee-9982-cdbfa963b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d55338a-51f6-43ee-9982-cdbfa963b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40bd5c06-23ad-42bf-b003-26e65dd413de', 'volume_name': 'volume-40bd5c06-23ad-42bf-b003-26e65dd413de', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4df57c2-a883-49ee-97fd-6cd8fd75a105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4df57c2-a883-49ee-97fd-6cd8fd75a105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc698e17-c1e3-4f9c-bba3-061f27db3590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:41 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Volume 40bd5c06-23ad-42bf-b003-26e65dd413de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40bd5c06-23ad-42bf-b003-26e65dd413de', 'volume_size': 1} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-63866241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bd5c06-23ad-42bf-b003-26e65dd413de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338cf0f7033047e6bee02161dc2bbd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:42Z,use_quota=True,user_id='e13c14f4751b471c8ac8c164e2be7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Creating volume 40bd5c06-23ad-42bf-b003-26e65dd413de {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:36:41 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:36:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:41 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de 1073741824 Sep 30 10:36:41 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:42 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.428s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:42 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Deleted volume successfully. Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ef1a2043-d17a-4247-971c-b8dcd2a5b7cb tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-bd479b49-29f7-4067-8e14-60ab723fdd18-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:42 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de 1073741824" returned: 0 in 0.681s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-57fdb73e-eb09-4c50-bf33-98e1ea01f839-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-57fdb73e-eb09-4c50-bf33-98e1ea01f839-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:42 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de Sep 30 10:36:42 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-quobyte-57fdb73e-eb09-4c50-bf33-98e1ea01f839" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-57fdb73e-eb09-4c50-bf33-98e1ea01f839" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c2faa4-1ba7-4316-b903-b393723128bc]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:42 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839 Sep 30 10:36:42 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:42 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de" returned: 0 in 0.358s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc698e17-c1e3-4f9c-bba3-061f27db3590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40bd5c06-23ad-42bf-b003-26e65dd413de', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a592410-b63e-4f0a-ac24-d78aac2d18ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:43 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Volume volume-40bd5c06-23ad-42bf-b003-26e65dd413de (40bd5c06-23ad-42bf-b003-26e65dd413de): created successfully Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a592410-b63e-4f0a-ac24-d78aac2d18ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Flow 'volume_create_manager' (1cddd3c7-0457-4d47-9cc7-8c13f8fa0d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-30aa917f-84d9-4129-98b1-e3d06490d88c tempest-VolumesSnapshotTestJSON-278545747 None] Created volume successfully. Sep 30 10:36:43 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839" returned: 0 in 0.420s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:43 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839 Sep 30 10:36:43 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:43 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-57fdb73e-eb09-4c50-bf33-98e1ea01f839" returned: 0 in 0.383s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-57fdb73e-eb09-4c50-bf33-98e1ea01f839" released by "delete_volume" :: held 0.873s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Created reservations ['8591e1b6-bf28-43a2-837e-2600d1248d1f', 'ea763b33-a5f5-4225-b8be-eaa503f93302', 'e83301ca-8610-4c33-bbc0-cbffe4d0af14', '23b2152b-78a2-4646-8301-8923d4033093'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:43 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:43 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Creating offline snapshot a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 of volume 40bd5c06-23ad-42bf-b003-26e65dd413de {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[507e02bb-de60-4c3a-b840-8d0fc915cb93]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-quobyte-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb026f-6d44-460f-9aa3-ccfe1b60359f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:44 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de Sep 30 10:36:44 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:44 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.580s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Deleted volume successfully. Sep 30 10:36:44 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 Sep 30 10:36:44 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9911d0f4-af91-4ffd-8a7e-242da78a4384 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-57fdb73e-eb09-4c50-bf33-98e1ea01f839-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:44 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de" returned: 0 in 0.540s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:44 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 1G Sep 30 10:36:44 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:44 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9" returned: 0 in 0.519s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:44 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9 Sep 30 10:36:44 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:45 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9" returned: 0 in 0.367s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9" released by "delete_volume" :: held 0.949s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Created reservations ['ac718655-f1e7-451f-9907-392df9f707e2', '5d91aeb6-ad18-45e0-ac9f-2de828d46099', '0e007a85-be15-41e3-bb93-5f3384cb3a60', '2b79f1ca-b133-441c-826b-b5c8de444337'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:45 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 1G" returned: 0 in 0.687s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40bd5c06-23ad-42bf-b003-26e65dd413de -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:45 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:45 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:45 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40bd5c06-23ad-42bf-b003-26e65dd413de -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 Sep 30 10:36:45 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:45 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.310s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:45 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Deleted volume successfully. Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2a99aa0b-5e81-4717-993c-d78379ace86e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-e4347cbe-f39d-4aef-abfb-5fb4dee9b7e9-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:45 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40bd5c06-23ad-42bf-b003-26e65dd413de -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19" returned: 0 in 0.421s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:45 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 is being set with open permissions: ugo+rw Sep 30 10:36:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:45 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 Sep 30 10:36:45 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:46 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19" returned: 0 in 0.257s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:46 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.info Sep 30 10:36:46 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:46 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.info" returned: 0 in 0.340s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:46 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.info is being set with open permissions: ugo+rw Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:46 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.info Sep 30 10:36:46 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-quobyte-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78fbc7e-c9dd-43ed-9284-d4b17a08a300]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:46 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.info" returned: 0 in 0.374s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:46 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da Sep 30 10:36:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:46 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:46 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c603609d-6c8c-41f2-ae95-2b2f74e71ea5 tempest-VolumesSnapshotTestJSON-278545747 None] Create snapshot completed successfully Sep 30 10:36:47 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da" returned: 0 in 0.470s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:47 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da Sep 30 10:36:47 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:47 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da" returned: 0 in 0.325s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da" released by "delete_volume" :: held 0.863s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Created reservations ['cd15b676-219d-46a6-9de3-bc93fd2b5141', 'c5a0eb17-8556-45c2-8b03-924c3c8ff71f', 'd0210acf-7c09-4473-8712-fb8280630705', '6b3aa3c3-ab06-4b2f-ad06-d96e4abdb215'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:47 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:47 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-d50b92d6-0228-459a-9766-163d65d45a9c-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-d50b92d6-0228-459a-9766-163d65d45a9c-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-quobyte-d50b92d6-0228-459a-9766-163d65d45a9c" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-d50b92d6-0228-459a-9766-163d65d45a9c" acquired by "delete_volume" :: waited 0.028s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2e6434-6c5b-4405-96f1-4a98c927b936]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:48 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.536s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:48 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Deleted volume successfully. Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Flow 'volume_create_manager' (35fcc1f9-f0f8-497c-888a-f95bdc043838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3c1d64-3fac-4f7a-aab7-c0616ddebd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3c1d64-3fac-4f7a-aab7-c0616ddebd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-559678264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76471dd4-a055-4343-9092-039544608aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338cf0f7033047e6bee02161dc2bbd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:36:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a86e33ca-beb7-4b76-b72e-4c24dcbc2c19,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:36:48Z,use_quota=True,user_id='e13c14f4751b471c8ac8c164e2be7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e187ec84-1908-4382-8197-de7dd0ee165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e187ec84-1908-4382-8197-de7dd0ee165d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6f4050-8eee-4410-8ba9-b230edc1334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6f4050-8eee-4410-8ba9-b230edc1334d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '76471dd4-a055-4343-9092-039544608aa2', 'volume_name': 'volume-76471dd4-a055-4343-9092-039544608aa2', 'volume_size': 2, 'snapshot_id': 'a86e33ca-beb7-4b76-b72e-4c24dcbc2c19'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:48 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c Sep 30 10:36:48 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdae78c2-f383-40ad-82ed-69b832400154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdae78c2-f383-40ad-82ed-69b832400154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e966a2-ac5b-458a-be53-7c155daa63f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:36:48 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Volume 76471dd4-a055-4343-9092-039544608aa2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-76471dd4-a055-4343-9092-039544608aa2', 'volume_size': 2, 'snapshot_id': 'a86e33ca-beb7-4b76-b72e-4c24dcbc2c19'} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ac1c9ee4-9fb3-44cd-b499-01467f53bd6d tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-1921aa78-8cfe-4ac8-aed9-8d8a95e0b6da-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-a86e33ca-beb7-4b76-b72e-4c24dcbc2c19-76471dd4-a055-4343-9092-039544608aa2" by "_create_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-a86e33ca-beb7-4b76-b72e-4c24dcbc2c19-76471dd4-a055-4343-9092-039544608aa2" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Creating volume 76471dd4-a055-4343-9092-039544608aa2 from snapshot a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 {{(pid=87013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-76471dd4-a055-4343-9092-039544608aa2" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-76471dd4-a055-4343-9092-039544608aa2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] snapshot: a86e33ca-beb7-4b76-b72e-4c24dcbc2c19, volume: 76471dd4-a055-4343-9092-039544608aa2, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ace50e-0bbb-412c-af7f-4aeead459b83]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:48 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 Sep 30 10:36:48 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:48 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c" returned: 0 in 0.488s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:48 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c Sep 30 10:36:48 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:48 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19" returned: 0 in 0.402s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40bd5c06-23ad-42bf-b003-26e65dd413de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[564bc8dc-c061-4db8-9a7a-258ef01aa9fe]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:48 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d50b92d6-0228-459a-9766-163d65d45a9c" returned: 0 in 0.273s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-d50b92d6-0228-459a-9766-163d65d45a9c" released by "delete_volume" :: held 0.868s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Created reservations ['98d4fc69-3b82-4c72-8b62-a2480853e3ad', 'f5cdbf16-a4df-42d0-aa9c-0fdc6bd32f96', '417653dd-4390-4779-b6b3-fa06e6fe1c62', '0bd5e203-66ef-454b-90e6-829415988142'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:49 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de Sep 30 10:36:49 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:49 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:49 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-e26fd728-4ba8-4902-8bd3-f9b5527daffa-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-e26fd728-4ba8-4902-8bd3-f9b5527daffa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-quobyte-cf320441-3418-4e4b-8398-45a20403efcb" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-cf320441-3418-4e4b-8398-45a20403efcb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-quobyte-e26fd728-4ba8-4902-8bd3-f9b5527daffa" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-e26fd728-4ba8-4902-8bd3-f9b5527daffa" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Deleting offline snapshot e26fd728-4ba8-4902-8bd3-f9b5527daffa of volume cf320441-3418-4e4b-8398-45a20403efcb {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] snapshot_file for this snap is: volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5594ea-4a7c-457d-8bf2-763d12064797]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:49 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de" returned: 0 in 0.557s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:49 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa Sep 30 10:36:49 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:49 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.488s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:49 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:49 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:49 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Deleted volume successfully. Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bb7e3674-7256-4818-9670-993473846758 tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-d50b92d6-0228-459a-9766-163d65d45a9c-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:49 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa" returned: 0 in 0.531s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf320441-3418-4e4b-8398-45a20403efcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ad0a46-745a-40da-ad7e-91bc197d5c29]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:50 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb Sep 30 10:36:50 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:50 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb" returned: 0 in 0.746s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:50 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa Sep 30 10:36:50 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:51 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa" returned: 0 in 1.073s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:51 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa Sep 30 10:36:51 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:52 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb.e26fd728-4ba8-4902-8bd3-f9b5527daffa" returned: 0 in 0.488s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-e26fd728-4ba8-4902-8bd3-f9b5527daffa" released by "_delete_snapshot" :: held 3.093s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-cf320441-3418-4e4b-8398-45a20403efcb" released by "delete_snapshot" :: held 3.128s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:52 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Created reservations ['febed18e-9937-40fc-9244-a52c1f3762be', '61de29e8-7d5c-4259-a6bb-5a68390bba4e', 'ef396b9b-81f7-4073-b354-9da7953f362b', '70de2cd5-f0bc-4f09-958d-f8d151791866'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Delete snapshot completed successfully. Sep 30 10:36:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a8a06d6f-618b-4e1d-8608-5d68f1a909ef tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-e26fd728-4ba8-4902-8bd3-f9b5527daffa-delete_snapshot" released by "delete_snapshot" :: held 3.469s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-cf320441-3418-4e4b-8398-45a20403efcb-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-cf320441-3418-4e4b-8398-45a20403efcb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "cinder-quobyte-cf320441-3418-4e4b-8398-45a20403efcb" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:36:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-cf320441-3418-4e4b-8398-45a20403efcb" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:36:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f86d48-3426-424f-bb3d-571ad4e95722]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:36:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:54 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb Sep 30 10:36:54 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:54 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb" returned: 0 in 0.638s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:54 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb Sep 30 10:36:54 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:55 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cf320441-3418-4e4b-8398-45a20403efcb" returned: 0 in 0.597s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-quobyte-cf320441-3418-4e4b-8398-45a20403efcb" released by "delete_volume" :: held 1.389s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Created reservations ['ba64183d-ef9b-4f2f-b87f-175f1826fb98', '6932c35c-59ff-467a-802a-681a45db8376', '21ed673a-38fe-478b-9104-cca72cde82e0', '47a7367a-a884-47ba-91f7-740cfa323515'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:36:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:36:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:36:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:36:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:36:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:36:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:36:55 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:36:55 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:36:56 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.501s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:56 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:36:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Deleted volume successfully. Sep 30 10:36:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-08dd9c7d-f5bd-4f6c-8090-f72bd8d57d2e tempest-CreateVolumesFromSnapshotTest-814930497 None] Lock "cinder-cf320441-3418-4e4b-8398-45a20403efcb-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:36:59 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 30 10:36:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2" returned: 0 in 10.429s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:36:59 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de, size 1024.00 MB, duration 10.43 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:36:59 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Converted 1024.00 MB image at 98.17 MB/s Sep 30 10:36:59 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 is being set with open permissions: ugo+rw Sep 30 10:36:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:00 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 Sep 30 10:37:00 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:00 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2" returned: 0 in 0.384s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-76471dd4-a055-4343-9092-039544608aa2" released by "_copy_volume_from_snapshot" :: held 11.925s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-a86e33ca-beb7-4b76-b72e-4c24dcbc2c19-76471dd4-a055-4343-9092-039544608aa2" released by "_create_volume_from_snapshot" :: held 12.039s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.057s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e966a2-ac5b-458a-be53-7c155daa63f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76471dd4-a055-4343-9092-039544608aa2', 'volume_size': 2, 'snapshot_id': 'a86e33ca-beb7-4b76-b72e-4c24dcbc2c19'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a42ff73-8bd9-4b56-96fe-ec33c1e4f4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:00 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Volume volume-76471dd4-a055-4343-9092-039544608aa2 (76471dd4-a055-4343-9092-039544608aa2): created successfully Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a42ff73-8bd9-4b56-96fe-ec33c1e4f4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Flow 'volume_create_manager' (35fcc1f9-f0f8-497c-888a-f95bdc043838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-01fd651d-6653-4b7d-8faf-96ac9d5849ed tempest-VolumesSnapshotTestJSON-278545747 None] Created volume successfully. Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-76471dd4-a055-4343-9092-039544608aa2-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-76471dd4-a055-4343-9092-039544608aa2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-76471dd4-a055-4343-9092-039544608aa2" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-76471dd4-a055-4343-9092-039544608aa2" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f273181-de90-4eaf-afc3-f7d7a2b3501b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:01 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 Sep 30 10:37:01 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:01 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2" returned: 0 in 0.515s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:01 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2 Sep 30 10:37:01 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:01 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-76471dd4-a055-4343-9092-039544608aa2" returned: 0 in 0.324s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-76471dd4-a055-4343-9092-039544608aa2" released by "delete_volume" :: held 0.899s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:01 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Created reservations ['9ef2c4a6-0a33-4e9f-9b71-18a2c10bae90', 'fb8c4ea5-37a5-4a7c-a286-d83db3b6e516', 'eb660dd7-09f7-447c-9511-e7706ffe2cdc', '86389e01-2514-45df-a1ac-d6886f5eeefb'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:02 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:37:02 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-a86e33ca-beb7-4b76-b72e-4c24dcbc2c19-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-a86e33ca-beb7-4b76-b72e-4c24dcbc2c19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-40bd5c06-23ad-42bf-b003-26e65dd413de" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-40bd5c06-23ad-42bf-b003-26e65dd413de" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-a86e33ca-beb7-4b76-b72e-4c24dcbc2c19" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-a86e33ca-beb7-4b76-b72e-4c24dcbc2c19" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Deleting offline snapshot a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 of volume 40bd5c06-23ad-42bf-b003-26e65dd413de {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] snapshot_file for this snap is: volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e033dbfa-d69c-4a8d-9e0d-daca29e61418]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:02 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.479s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:37:02 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Deleted volume successfully. Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-32605d03-d143-4631-be1b-4627f967fe55 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-76471dd4-a055-4343-9092-039544608aa2-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:02 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 Sep 30 10:37:02 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:02 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19" returned: 0 in 0.543s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40bd5c06-23ad-42bf-b003-26e65dd413de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:03 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c97f6b6-89f9-4acb-83e4-d44d8b176cd3]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:03 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de Sep 30 10:37:03 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:03 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de" returned: 0 in 0.620s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:03 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 Sep 30 10:37:03 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:04 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19" returned: 0 in 0.420s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:04 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19 Sep 30 10:37:04 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:04 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de.a86e33ca-beb7-4b76-b72e-4c24dcbc2c19" returned: 0 in 0.365s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-a86e33ca-beb7-4b76-b72e-4c24dcbc2c19" released by "_delete_snapshot" :: held 2.167s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-40bd5c06-23ad-42bf-b003-26e65dd413de" released by "delete_snapshot" :: held 2.219s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Flow 'volume_create_manager' (e6d694f1-cf9e-4cd3-aac5-8c33ab59dcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0809451-e565-45b2-9c09-6b9093cb5e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0809451-e565-45b2-9c09-6b9093cb5e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1874126256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c9243c-ae95-49fb-94a7-534000276433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14b9131a56a41d1a739e3ff5601342f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:05Z,use_quota=True,user_id='91951d02c494465aa34b830aac3924e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d15fca-cbfb-42c1-a0dc-5dd116556bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d15fca-cbfb-42c1-a0dc-5dd116556bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe73e11-f2dd-416d-ae29-bd1de0570762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.image.glance [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Creating Keystone auth plugin from conf {{(pid=87013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Created reservations ['c123f95e-67fc-49d9-9d5c-0e9dae3ffedf', '10c6a2f6-cfdd-4a8d-aaa1-0a53c8e7fdf3', '553fc805-a1bd-4cd8-96f9-73310a304fa7', '0a6b6830-d265-46bd-9ddf-0e487fac583e'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:04 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Delete snapshot completed successfully. Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Acquiring lock "cinder-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76b936a6-627d-486b-bb89-d10806bbccc3 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-a86e33ca-beb7-4b76-b72e-4c24dcbc2c19-delete_snapshot" released by "delete_snapshot" :: held 2.503s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Lock "cinder-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Acquiring lock "cinder-quobyte-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Lock "cinder-quobyte-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff5b535-8ab1-4e6e-8887-a204c33ad17c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:05 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b Sep 30 10:37:05 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe73e11-f2dd-416d-ae29-bd1de0570762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86c9243c-ae95-49fb-94a7-534000276433', 'volume_name': 'volume-86c9243c-ae95-49fb-94a7-534000276433', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f684fa5d-ee35-403b-9f8e-a2c1cd0022b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f684fa5d-ee35-403b-9f8e-a2c1cd0022b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d155ffb-4fc6-4544-b9d2-de09916b32f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:05 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Volume 86c9243c-ae95-49fb-94a7-534000276433: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86c9243c-ae95-49fb-94a7-534000276433', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Trying to clone 86c9243c-ae95-49fb-94a7-534000276433 from image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]). {{(pid=87013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 10:37:05 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b" returned: 0 in 0.497s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:05 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b Sep 30 10:37:05 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Flow 'volume_create_manager' (0ae94cb4-c4a8-40a8-a8f4-947e9cc4377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f2c2db-b7c1-4f16-b919-1c470e4b4cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-40bd5c06-23ad-42bf-b003-26e65dd413de-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:05 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f2c2db-b7c1-4f16-b919-1c470e4b4cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef3a05c-8fdd-4ade-98f7-2362eba9c60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facd6328091e46039983c0789ba2b245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:05Z,use_quota=True,user_id='2300f8a6ae4449f190d253857cd68986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3ae172-f4b8-453f-8860-6c41d51c9944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3ae172-f4b8-453f-8860-6c41d51c9944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5795d9-543e-4f58-9333-90ea4c4c46c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.image.glance [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Creating Keystone auth plugin from conf {{(pid=87013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b" returned: 0 in 0.388s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Lock "cinder-quobyte-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b" released by "delete_volume" :: held 0.954s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-40bd5c06-23ad-42bf-b003-26e65dd413de-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 10:37:05 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Image download 20.69 MB at 20.69 MB/s Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-40bd5c06-23ad-42bf-b003-26e65dd413de" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-40bd5c06-23ad-42bf-b003-26e65dd413de" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bdfbd4-91d6-4747-8f86-f24fd64e5ba0]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[439441de-b420-4d39-adfa-e7e6ddef06b3]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:05 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Created reservations ['ce39e9f0-8ff5-40cc-82c5-1902e4b6d286', '142af161-5e21-439a-b205-29de118e7694', '3c7cc6fe-0786-45de-af0c-96385813fecd', '224acada-0af9-4d9b-9931-d03fbcea1e2a'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5795d9-543e-4f58-9333-90ea4c4c46c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ef3a05c-8fdd-4ade-98f7-2362eba9c60e', 'volume_name': 'volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e', 'volume_size': 1, 'image_id': 'df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7278ea2c6284f46628b71e915507737e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'facd6328091e46039983c0789ba2b245', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'afa3f677436a56e9bc9de31c9d924fc46b4673e7adfc939ac59324eaf2d0c4aec9d263e39ee87defb3cb9b2336f77df4b706dc40bc21a87506c3cff0b43c8acb', 'id': 'df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'created_at': datetime.datetime(2026, 9, 30, 8, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 37, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df4bff4e-ee15-483d-a6a6-df883ee1ba8c/file', 'properties': {}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf14bdf-cc13-403b-b9cb-69b04f1f9cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf14bdf-cc13-403b-b9cb-69b04f1f9cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:06 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD Sep 30 10:37:06 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6743f72c-6016-4412-9674-7a1259533ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:06 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Volume 0ef3a05c-8fdd-4ade-98f7-2362eba9c60e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e', 'volume_size': 1, 'image_id': 'df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7278ea2c6284f46628b71e915507737e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'facd6328091e46039983c0789ba2b245', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'afa3f677436a56e9bc9de31c9d924fc46b4673e7adfc939ac59324eaf2d0c4aec9d263e39ee87defb3cb9b2336f77df4b706dc40bc21a87506c3cff0b43c8acb', 'id': 'df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'created_at': datetime.datetime(2026, 9, 30, 8, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 37, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df4bff4e-ee15-483d-a6a6-df883ee1ba8c/file', 'properties': {}}, 'image_service': } Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Trying to clone 0ef3a05c-8fdd-4ade-98f7-2362eba9c60e from image df4bff4e-ee15-483d-a6a6-df883ee1ba8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'metadata': {}}]). {{(pid=87013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 10:37:06 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de Sep 30 10:37:06 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:06 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:37:06 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 10:37:06 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Image download 0.00 MB at 0.00 MB/s Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[09061c25-6a11-457c-8d49-aa2cd7ad65ae]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:06 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Temporary image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e is fetched for user 91951d02c494465aa34b830aac3924e8. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 10:37:06 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:06 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD Sep 30 10:37:06 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.323s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:37:06 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Deleted volume successfully. Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de" returned: 0 in 0.511s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c1b5b4-2ea0-4536-bf9e-d18f34aa24f8]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:06 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de Sep 30 10:37:06 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c5a7feea-7181-4f37-bcfa-a50ba615daec tempest-AttachVolumeShelveTestJSON-1086713640 None] Lock "cinder-5793e1e6-ee78-4c5d-9dd8-dc8fe523b62b-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:06 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD Sep 30 10:37:06 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:06 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:06 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-40bd5c06-23ad-42bf-b003-26e65dd413de" returned: 0 in 0.290s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-40bd5c06-23ad-42bf-b003-26e65dd413de" released by "delete_volume" :: held 0.889s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:06 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD Sep 30 10:37:06 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Created reservations ['49a2dce8-c461-4806-be65-cf4a1c6ad62c', 'dacaa629-130b-4407-8bbd-77f2a315ec94', 'b3baf2c4-5576-487e-90c2-8bea82bd21f6', 'fb694df8-7b81-4a81-85ba-d195b20ce131'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:06 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1874126256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c9243c-ae95-49fb-94a7-534000276433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14b9131a56a41d1a739e3ff5601342f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:05Z,use_quota=True,user_id='91951d02c494465aa34b830aac3924e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Creating volume 86c9243c-ae95-49fb-94a7-534000276433 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:37:06 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:06 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 1073741824 Sep 30 10:37:06 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:07 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:37:07 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:07 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Temporary image df4bff4e-ee15-483d-a6a6-df883ee1ba8c is fetched for user 2300f8a6ae4449f190d253857cd68986. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3d725e-66d0-4d4a-83d1-a44a7d50aafa]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:07 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:07 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD Sep 30 10:37:07 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.302s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:37:07 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Deleted volume successfully. Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6905d81c-ff92-474e-9439-1af073e1b971 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-40bd5c06-23ad-42bf-b003-26e65dd413de-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:07 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 1073741824" returned: 0 in 0.580s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:07 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:07 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 Sep 30 10:37:07 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:07 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD Sep 30 10:37:07 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:07 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433" returned: 0 in 0.310s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Attempting download of 0e96b9f2-4ae9-48ec-8d88-8e11a591034e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}])) to volume 86c9243c-ae95-49fb-94a7-534000276433. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 10:37:07 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef3a05c-8fdd-4ade-98f7-2362eba9c60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facd6328091e46039983c0789ba2b245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:05Z,use_quota=True,user_id='2300f8a6ae4449f190d253857cd68986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Creating volume 0ef3a05c-8fdd-4ade-98f7-2362eba9c60e {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:37:07 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc15193-6c18-4f88-a256-c15a77a25276]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_y95uislo {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:07 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e 1073741824 Sep 30 10:37:07 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:08 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_y95uislo Sep 30 10:37:08 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:08 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_y95uislo" returned: 0 in 0.480s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_y95uislo {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:08 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e 1073741824" returned: 0 in 0.676s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:08 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_y95uislo Sep 30 10:37:08 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Flow 'volume_create_manager' (e7062666-b46d-44e7-b083-b94beedb3a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbc297b-895d-48de-bb57-4d01f0640bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbc297b-895d-48de-bb57-4d01f0640bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-727682207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da4fbe0-ba13-42f7-b8b7-e720081f0737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338cf0f7033047e6bee02161dc2bbd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:09Z,use_quota=True,user_id='e13c14f4751b471c8ac8c164e2be7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716b235a-2768-482c-9015-de4d3305a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716b235a-2768-482c-9015-de4d3305a12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5422bff8-c3b4-4ecd-aec7-310d84718ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5422bff8-c3b4-4ecd-aec7-310d84718ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da4fbe0-ba13-42f7-b8b7-e720081f0737', 'volume_name': 'volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31f428f-4c17-4114-99ab-dc9213fa8392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31f428f-4c17-4114-99ab-dc9213fa8392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7670164c-6007-4880-a9b3-562c227f44ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:08 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Volume 9da4fbe0-ba13-42f7-b8b7-e720081f0737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737', 'volume_size': 1} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:08 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e Sep 30 10:37:08 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:08 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_y95uislo" returned: 1 in 0.405s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_y95uislo' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[867b4da2-a1ef-4146-bc24-2d5ed26fa78b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:08 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD Sep 30 10:37:08 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:09 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e" returned: 0 in 0.306s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-727682207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da4fbe0-ba13-42f7-b8b7-e720081f0737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338cf0f7033047e6bee02161dc2bbd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:09Z,use_quota=True,user_id='e13c14f4751b471c8ac8c164e2be7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Creating volume 9da4fbe0-ba13-42f7-b8b7-e720081f0737 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:37:09 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:09 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 1073741824 Sep 30 10:37:09 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Attempting download of df4bff4e-ee15-483d-a6a6-df883ee1ba8c ((None, [{'url': 'file:///opt/stack/data/glance/images/df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'metadata': {}}])) to volume 0ef3a05c-8fdd-4ade-98f7-2362eba9c60e. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b411c305-20c5-4c91-8036-390d0573506f]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_xyn3zxsl {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:09 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] 0e96b9f2-4ae9-48ec-8d88-8e11a591034e was qcow2, converting to qcow2 {{(pid=87013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:09 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 Sep 30 10:37:09 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:09 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_xyn3zxsl Sep 30 10:37:09 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:09 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:09 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_xyn3zxsl" returned: 0 in 0.380s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_xyn3zxsl {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 1073741824" returned: 0 in 0.527s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:09 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 Sep 30 10:37:09 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:09 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_xyn3zxsl Sep 30 10:37:09 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:09 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737" returned: 0 in 0.312s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7670164c-6007-4880-a9b3-562c227f44ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a398ab62-167f-4b09-8c11-35c699a504b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:09 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Volume volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 (9da4fbe0-ba13-42f7-b8b7-e720081f0737): created successfully Sep 30 10:37:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a398ab62-167f-4b09-8c11-35c699a504b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Flow 'volume_create_manager' (e7062666-b46d-44e7-b083-b94beedb3a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:10 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-1149abba-ca23-44ce-8ad2-ce0fd415c7a9 tempest-VolumesSnapshotTestJSON-278545747 None] Created volume successfully. Sep 30 10:37:10 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_xyn3zxsl" returned: 1 in 0.519s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_xyn3zxsl' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2db9c9-6128-4451-b2fa-055f368181a5]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:10 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD Sep 30 10:37:10 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:10 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:10 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD Sep 30 10:37:10 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:10 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] df4bff4e-ee15-483d-a6a6-df883ee1ba8c was raw, converting to qcow2 {{(pid=87013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:10 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e Sep 30 10:37:10 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Creating offline snapshot fb574240-01e8-4fc2-aa33-6cac501ebf2b of volume 9da4fbe0-ba13-42f7-b8b7-e720081f0737 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:37:11 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aec8114-413e-4238-880e-ff96b3ecba2a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:11 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 Sep 30 10:37:11 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:11 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737" returned: 0 in 0.527s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:11 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b 1G Sep 30 10:37:11 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:11 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e" returned: 0 in 0.736s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:11 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df4bff4e-ee15-483d-a6a6-df883ee1ba8c_ayqzh885devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:37:11 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 10:37:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:11 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433" returned: 0 in 2.420s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:11 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_jq1_d_1qdevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:37:11 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Converted 112.00 MB image at 46.20 MB/s Sep 30 10:37:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:11 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e 1G Sep 30 10:37:11 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:11 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 1G Sep 30 10:37:11 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:12 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b 1G" returned: 0 in 0.488s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:12 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e 1G" returned: 0 in 0.432s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Downloaded image df4bff4e-ee15-483d-a6a6-df883ee1ba8c ((None, [{'url': 'file:///opt/stack/data/glance/images/df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'metadata': {}}])) to volume 0ef3a05c-8fdd-4ade-98f7-2362eba9c60e successfully. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Temporary image df4bff4e-ee15-483d-a6a6-df883ee1ba8c for user 2300f8a6ae4449f190d253857cd68986 is deleted. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Marking volume 0ef3a05c-8fdd-4ade-98f7-2362eba9c60e as bootable. {{(pid=87013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 10:37:12 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b Sep 30 10:37:12 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:12 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Copying metadata from image df4bff4e-ee15-483d-a6a6-df883ee1ba8c to 0ef3a05c-8fdd-4ade-98f7-2362eba9c60e. {{(pid=87013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Creating volume glance metadata for volume 0ef3a05c-8fdd-4ade-98f7-2362eba9c60e backed by image df4bff4e-ee15-483d-a6a6-df883ee1ba8c with: {'image_id': 'df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7278ea2c6284f46628b71e915507737e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 1G" returned: 0 in 0.452s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Downloaded image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}])) to volume 86c9243c-ae95-49fb-94a7-534000276433 successfully. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Temporary image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e for user 91951d02c494465aa34b830aac3924e8 is deleted. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Marking volume 86c9243c-ae95-49fb-94a7-534000276433 as bootable. {{(pid=87013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Copying metadata from image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e to 86c9243c-ae95-49fb-94a7-534000276433. {{(pid=87013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Creating volume glance metadata for volume 86c9243c-ae95-49fb-94a7-534000276433 backed by image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6743f72c-6016-4412-9674-7a1259533ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e', 'volume_size': 1, 'image_id': 'df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7278ea2c6284f46628b71e915507737e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'facd6328091e46039983c0789ba2b245', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'afa3f677436a56e9bc9de31c9d924fc46b4673e7adfc939ac59324eaf2d0c4aec9d263e39ee87defb3cb9b2336f77df4b706dc40bc21a87506c3cff0b43c8acb', 'id': 'df4bff4e-ee15-483d-a6a6-df883ee1ba8c', 'created_at': datetime.datetime(2026, 9, 30, 8, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 37, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df4bff4e-ee15-483d-a6a6-df883ee1ba8c/file', 'properties': {}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a666a13-177a-4dba-96c3-1073d1252a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:12 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Volume volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e (0ef3a05c-8fdd-4ade-98f7-2362eba9c60e): created successfully Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a666a13-177a-4dba-96c3-1073d1252a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Flow 'volume_create_manager' (0ae94cb4-c4a8-40a8-a8f4-947e9cc4377e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b69a1b6b-1d06-426a-a305-e4032075d79d tempest-VolumeImageDependencyTests-682716217 None] Created volume successfully. Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d155ffb-4fc6-4544-b9d2-de09916b32f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c9243c-ae95-49fb-94a7-534000276433', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b97cfe3-faba-431e-9563-e99b5c99cb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:12 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Volume volume-86c9243c-ae95-49fb-94a7-534000276433 (86c9243c-ae95-49fb-94a7-534000276433): created successfully Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b97cfe3-faba-431e-9563-e99b5c99cb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Flow 'volume_create_manager' (e6d694f1-cf9e-4cd3-aac5-8c33ab59dcfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e31495d4-e3b9-4813-8536-06f0d21b263e tempest-TestShelveInstance-935076481 None] Created volume successfully. Sep 30 10:37:12 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b" returned: 0 in 0.409s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:12 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b is being set with open permissions: ugo+rw Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:12 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b Sep 30 10:37:12 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:12 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b" returned: 0 in 0.308s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:12 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.info Sep 30 10:37:12 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Acquiring lock "cinder-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Lock "cinder-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:13 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.info" returned: 0 in 0.306s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:13 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.info is being set with open permissions: ugo+rw Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Acquiring lock "cinder-quobyte-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:13 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.info Sep 30 10:37:13 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Lock "cinder-quobyte-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c269cb34-d5cd-4422-8d73-4fb31083e846]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:13 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e Sep 30 10:37:13 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:13 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.info" returned: 0 in 0.332s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:13 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-acfe549c-5f02-4c35-a6c1-72867fb485b9 tempest-VolumesSnapshotTestJSON-278545747 None] Create snapshot completed successfully Sep 30 10:37:13 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e" returned: 0 in 0.504s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:13 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e Sep 30 10:37:13 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:14 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e" returned: 0 in 0.310s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Lock "cinder-quobyte-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e" released by "delete_volume" :: held 0.891s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Created reservations ['9a6b9ea7-db62-4520-a58c-9188c13bfd3f', '955410b2-461e-477c-9458-6edd309da4a1', 'e2dacc89-969e-4826-9029-d5e587129678', 'adc92d98-66fb-4dd3-b310-2ea78f0f8550'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:14 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:37:14 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:14 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.600s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:37:14 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Deleted volume successfully. Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2f7b3c65-1f07-4b55-8e99-81ef5943802b tempest-VolumeImageDependencyTests-682716217 None] Lock "cinder-0ef3a05c-8fdd-4ade-98f7-2362eba9c60e-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:14 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Flow 'volume_create_manager' (44bcebe4-44ed-4b87-8023-4fd37436c2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ed75ad-d2cd-4c05-962c-394a744ed277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ed75ad-d2cd-4c05-962c-394a744ed277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1228090211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4176258c-4ca3-4eac-951b-6cc45d85199a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338cf0f7033047e6bee02161dc2bbd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb574240-01e8-4fc2-aa33-6cac501ebf2b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:15Z,use_quota=True,user_id='e13c14f4751b471c8ac8c164e2be7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aacdd6d0-dd9e-4c09-916d-72d43245f31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aacdd6d0-dd9e-4c09-916d-72d43245f31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece9f58-ebb2-4457-a932-d5eb5831f436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece9f58-ebb2-4457-a932-d5eb5831f436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4176258c-4ca3-4eac-951b-6cc45d85199a', 'volume_name': 'volume-4176258c-4ca3-4eac-951b-6cc45d85199a', 'volume_size': 1, 'snapshot_id': 'fb574240-01e8-4fc2-aa33-6cac501ebf2b'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7bb69d-848d-47a0-bc1f-1d5ce67e8980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7bb69d-848d-47a0-bc1f-1d5ce67e8980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0325520-5ade-435c-bdae-d2c6250893ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:15 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Volume 4176258c-4ca3-4eac-951b-6cc45d85199a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4176258c-4ca3-4eac-951b-6cc45d85199a', 'volume_size': 1, 'snapshot_id': 'fb574240-01e8-4fc2-aa33-6cac501ebf2b'} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-fb574240-01e8-4fc2-aa33-6cac501ebf2b-4176258c-4ca3-4eac-951b-6cc45d85199a" by "_create_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-fb574240-01e8-4fc2-aa33-6cac501ebf2b-4176258c-4ca3-4eac-951b-6cc45d85199a" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Creating volume 4176258c-4ca3-4eac-951b-6cc45d85199a from snapshot fb574240-01e8-4fc2-aa33-6cac501ebf2b {{(pid=87013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-4176258c-4ca3-4eac-951b-6cc45d85199a" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-4176258c-4ca3-4eac-951b-6cc45d85199a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] snapshot: fb574240-01e8-4fc2-aa33-6cac501ebf2b, volume: 4176258c-4ca3-4eac-951b-6cc45d85199a, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cab0daa-6b5a-440e-a7cb-88fb76ff710f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:15 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b Sep 30 10:37:15 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:15 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b" returned: 0 in 0.656s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d85006-df3c-40c1-a19d-51395ebf81f8]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:16 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 Sep 30 10:37:16 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:16 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737" returned: 0 in 0.765s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:37:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:37:16 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:37:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:16 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a Sep 30 10:37:16 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-74f34a31-f5c8-4350-89d6-6a864803da7e req-d3471391-0fee-4370-9bb8-907b839166eb tempest-TestShelveInstance-935076481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=129,cinder:UPDATE=152,cinder:DELETE=17,cinder:INSERT=48 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=131,cinder:UPDATE=135,cinder:INSERT=42,cinder:DELETE=9 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Flow 'volume_create_manager' (5a53cdfe-75b4-4366-8a12-e50b015b697c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12f812d-2049-4489-b003-67b84ccf43b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12f812d-2049-4489-b003-67b84ccf43b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1504046067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ab4ff8-1d5f-47c8-8517-dc1539e5c570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d044b29c484dd98489bf392add71cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:19Z,use_quota=True,user_id='c3c07846ec4f43fbbcb4cd70a69578d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfd7608-140b-43d1-8745-99ef6cea5f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfd7608-140b-43d1-8745-99ef6cea5f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7bfbc9-e0ad-45ed-9e3e-f1695d7aeea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7bfbc9-e0ad-45ed-9e3e-f1695d7aeea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ab4ff8-1d5f-47c8-8517-dc1539e5c570', 'volume_name': 'volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4099e17-3365-4621-a41d-0e6382438513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4099e17-3365-4621-a41d-0e6382438513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fe7458-de3b-4309-ac97-b5c0befcb167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:19 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570', 'volume_size': 1} Sep 30 10:37:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:25 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a" returned: 0 in 9.160s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:25 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737, size 1024.00 MB, duration 9.16 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:37:25 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Converted 1024.00 MB image at 111.77 MB/s Sep 30 10:37:25 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a is being set with open permissions: ugo+rw Sep 30 10:37:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:25 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a Sep 30 10:37:25 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:26 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a" returned: 0 in 0.251s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-4176258c-4ca3-4eac-951b-6cc45d85199a" released by "_copy_volume_from_snapshot" :: held 10.970s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-fb574240-01e8-4fc2-aa33-6cac501ebf2b-4176258c-4ca3-4eac-951b-6cc45d85199a" released by "_create_volume_from_snapshot" :: held 11.046s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.076s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-74f34a31-f5c8-4350-89d6-6a864803da7e req-d3471391-0fee-4370-9bb8-907b839166eb tempest-TestShelveInstance-935076481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.057s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-74f34a31-f5c8-4350-89d6-6a864803da7e req-d3471391-0fee-4370-9bb8-907b839166eb tempest-TestShelveInstance-935076481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.909s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1504046067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ab4ff8-1d5f-47c8-8517-dc1539e5c570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d044b29c484dd98489bf392add71cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:19Z,use_quota=True,user_id='c3c07846ec4f43fbbcb4cd70a69578d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Creating volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:37:26 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0325520-5ade-435c-bdae-d2c6250893ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4176258c-4ca3-4eac-951b-6cc45d85199a', 'volume_size': 1, 'snapshot_id': 'fb574240-01e8-4fc2-aa33-6cac501ebf2b'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:26 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 1073741824 Sep 30 10:37:26 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5fd4db2-46a8-4034-b051-50619c85d8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:26 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Volume volume-4176258c-4ca3-4eac-951b-6cc45d85199a (4176258c-4ca3-4eac-951b-6cc45d85199a): created successfully Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5fd4db2-46a8-4034-b051-50619c85d8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Flow 'volume_create_manager' (44bcebe4-44ed-4b87-8023-4fd37436c2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-74f34a31-f5c8-4350-89d6-6a864803da7e req-d3471391-0fee-4370-9bb8-907b839166eb tempest-TestShelveInstance-935076481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-86c9243c-ae95-49fb-94a7-534000276433', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9adce04d-8215-42a4-ba58-e956b54e34d8', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:37:26 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-26e25211-005d-456a-9dbd-714b42b0d5ce tempest-VolumesSnapshotTestJSON-278545747 None] Created volume successfully. Sep 30 10:37:26 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-74f34a31-f5c8-4350-89d6-6a864803da7e req-d3471391-0fee-4370-9bb8-907b839166eb tempest-TestShelveInstance-935076481 None] attachment_update completed successfully. Sep 30 10:37:26 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 1073741824" returned: 0 in 0.572s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:26 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 Sep 30 10:37:26 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-4176258c-4ca3-4eac-951b-6cc45d85199a-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-4176258c-4ca3-4eac-951b-6cc45d85199a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-4176258c-4ca3-4eac-951b-6cc45d85199a" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-4176258c-4ca3-4eac-951b-6cc45d85199a" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d97098-3fa5-43bb-bd0b-67ec65db220f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:27 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" returned: 0 in 0.362s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fe7458-de3b-4309-ac97-b5c0befcb167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50008c44-13c0-4edb-94d2-f6195638b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:27 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Volume volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 (94ab4ff8-1d5f-47c8-8517-dc1539e5c570): created successfully Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50008c44-13c0-4edb-94d2-f6195638b708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Flow 'volume_create_manager' (5a53cdfe-75b4-4366-8a12-e50b015b697c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:27 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a Sep 30 10:37:27 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:27 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-78cc228c-11e0-4277-8baf-c80880179dc0 tempest-SnapshotsActionsTest-1760244896 None] Created volume successfully. Sep 30 10:37:27 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a" returned: 0 in 0.716s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:27 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a Sep 30 10:37:27 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:28 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4176258c-4ca3-4eac-951b-6cc45d85199a" returned: 0 in 0.466s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-4176258c-4ca3-4eac-951b-6cc45d85199a" released by "delete_volume" :: held 1.269s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Created reservations ['6f67b86a-a39d-4538-aa9f-65055df00b4c', 'c4438b3f-a166-45f7-9389-a1eb3a25afbb', '2b08942d-ab62-474a-9b2d-4b436fef8679', '6d40e72a-6d98-4a8b-99ce-4d1f3221bd21'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Creating offline snapshot 52b42395-8b26-4d77-b90d-c451d363e58a of volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:37:28 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:37:28 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d49402-a7e2-4cbe-a561-8f311cb163a4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:28 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 Sep 30 10:37:28 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:29 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:37:29 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Deleted volume successfully. Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70577c6e-9578-471e-8b6e-b0220f3a32c8 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-4176258c-4ca3-4eac-951b-6cc45d85199a-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:29 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" returned: 0 in 0.516s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:29 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a 1G Sep 30 10:37:29 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-fb574240-01e8-4fc2-aa33-6cac501ebf2b-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-fb574240-01e8-4fc2-aa33-6cac501ebf2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-9da4fbe0-ba13-42f7-b8b7-e720081f0737" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-9da4fbe0-ba13-42f7-b8b7-e720081f0737" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-fb574240-01e8-4fc2-aa33-6cac501ebf2b" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-fb574240-01e8-4fc2-aa33-6cac501ebf2b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Deleting offline snapshot fb574240-01e8-4fc2-aa33-6cac501ebf2b of volume 9da4fbe0-ba13-42f7-b8b7-e720081f0737 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] snapshot_file for this snap is: volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[046df3ab-59a3-413c-b828-404a51ec3499]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:29 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b Sep 30 10:37:29 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:29 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a 1G" returned: 0 in 0.654s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:29 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:29 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:29 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b" returned: 0 in 0.479s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:30 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ed8c84-7bf5-4068-b378-5bdc762af9d8]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:30 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 Sep 30 10:37:30 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:30 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.431s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:30 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a is being set with open permissions: ugo+rw Sep 30 10:37:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:30 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:30 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:30 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.379s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:30 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.info Sep 30 10:37:30 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:30 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737" returned: 0 in 0.920s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:31 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b Sep 30 10:37:31 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:31 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.info" returned: 0 in 0.415s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:31 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.info is being set with open permissions: ugo+rw Sep 30 10:37:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:31 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.info Sep 30 10:37:31 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:31 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b" returned: 0 in 0.485s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:31 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b Sep 30 10:37:31 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:31 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.info" returned: 0 in 0.451s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.056s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f2d3e893-8154-4692-99da-4952e6ebeaaa tempest-SnapshotsActionsTest-1760244896 None] Create snapshot completed successfully Sep 30 10:37:32 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737.fb574240-01e8-4fc2-aa33-6cac501ebf2b" returned: 0 in 0.563s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-fb574240-01e8-4fc2-aa33-6cac501ebf2b" released by "_delete_snapshot" :: held 2.628s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-9da4fbe0-ba13-42f7-b8b7-e720081f0737" released by "delete_snapshot" :: held 2.672s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:32 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Created reservations ['e1318080-58fc-4aef-b9e2-007dbec735ef', '40057585-cc3b-48c7-a9ec-73f288c05a60', '17c738f3-de5f-4d5a-aca9-ef905b9e08a8', '196c28da-83ed-455c-b144-644e5c5754c9'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Delete snapshot completed successfully. Sep 30 10:37:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc5f1089-d660-441d-943e-93cc4824691b tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-fb574240-01e8-4fc2-aa33-6cac501ebf2b-delete_snapshot" released by "delete_snapshot" :: held 2.980s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-9da4fbe0-ba13-42f7-b8b7-e720081f0737-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-9da4fbe0-ba13-42f7-b8b7-e720081f0737-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-9da4fbe0-ba13-42f7-b8b7-e720081f0737" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:33 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-9da4fbe0-ba13-42f7-b8b7-e720081f0737" acquired by "delete_volume" :: waited 0.051s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:33 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdc65be-5f75-4e5a-af99-8ec1f0da10f3]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] Creating offline snapshot 2abbf854-a151-4972-a4cf-0b6b7660674d of volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:37:33 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 Sep 30 10:37:33 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:33 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2b3da7-5091-4201-a18e-eaa8b43718d4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:33 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:33 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:33 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737" returned: 0 in 0.728s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:33 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737 Sep 30 10:37:33 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:34 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.636s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:34 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d 1G Sep 30 10:37:34 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:34 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da4fbe0-ba13-42f7-b8b7-e720081f0737" returned: 0 in 0.369s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-9da4fbe0-ba13-42f7-b8b7-e720081f0737" released by "delete_volume" :: held 1.215s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Created reservations ['cfa5545e-24cf-49d8-84d1-d51bc9b921b8', '4756f25e-d021-4f02-ad9c-6cee73462181', 'a0be5ff3-0904-4f6d-8948-609216bf2f96', '65b61ad4-60be-455a-8f69-b990c7b7d320'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:34 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:37:34 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:34 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d 1G" returned: 0 in 0.687s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:34 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d Sep 30 10:37:34 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:34 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.347s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:37:34 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Deleted volume successfully. Sep 30 10:37:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5bb91117-346e-44c1-8756-47bca3ffedc1 tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-9da4fbe0-ba13-42f7-b8b7-e720081f0737-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:35 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d" returned: 0 in 0.418s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:35 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d is being set with open permissions: ugo+rw Sep 30 10:37:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:35 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d Sep 30 10:37:35 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-55703381-5c11-4d3c-a67f-cb404bb8f767-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-55703381-5c11-4d3c-a67f-cb404bb8f767-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "cinder-quobyte-55703381-5c11-4d3c-a67f-cb404bb8f767" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-55703381-5c11-4d3c-a67f-cb404bb8f767" acquired by "delete_volume" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:35 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4f0840-4e1c-40bb-b5bf-5d02005e7255]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:35 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d" returned: 0 in 0.505s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2bfa128c-d28e-401c-b2ea-0845c2ff3a25 tempest-SnapshotsActionsTest-1760244896 None] Create snapshot completed successfully Sep 30 10:37:35 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 Sep 30 10:37:35 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:36 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767" returned: 0 in 0.470s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:36 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767 Sep 30 10:37:36 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:36 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-55703381-5c11-4d3c-a67f-cb404bb8f767" returned: 0 in 0.344s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-quobyte-55703381-5c11-4d3c-a67f-cb404bb8f767" released by "delete_volume" :: held 0.934s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Created reservations ['8558df4d-012e-4010-a1aa-3ae8b82443a2', '6b45ac1d-c41c-426f-b8aa-d76710983c20', '2412849f-f0c2-4283-a6fc-4ea829ed23ee', 'f42299e1-131c-4127-b36f-1f8532cd685c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-2abbf854-a151-4972-a4cf-0b6b7660674d-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:36 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:37:36 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-2abbf854-a151-4972-a4cf-0b6b7660674d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-quobyte-2abbf854-a151-4972-a4cf-0b6b7660674d" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-2abbf854-a151-4972-a4cf-0b6b7660674d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Deleting offline snapshot 2abbf854-a151-4972-a4cf-0b6b7660674d of volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] snapshot_file for this snap is: volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[072170fc-897f-4020-a29a-0703aa8cf09c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:36 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.297s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:37:36 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d Sep 30 10:37:36 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:36 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Deleted volume successfully. Sep 30 10:37:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e786d330-8883-42e2-9b18-6f0ceecb8cee tempest-VolumesSnapshotTestJSON-278545747 None] Lock "cinder-55703381-5c11-4d3c-a67f-cb404bb8f767-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:37 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:37:37 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:37 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d" returned: 0 in 0.399s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[45612a26-80fe-47ca-9a09-dd4cb22b06b7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:37 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.260s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:37:37 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:37 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:37 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.359s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:37 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d Sep 30 10:37:37 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:37 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d" returned: 0 in 0.403s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:38 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d Sep 30 10:37:38 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:38 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.2abbf854-a151-4972-a4cf-0b6b7660674d" returned: 0 in 0.267s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-2abbf854-a151-4972-a4cf-0b6b7660674d" released by "_delete_snapshot" :: held 1.542s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" released by "delete_snapshot" :: held 1.573s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:38 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Created reservations ['023484f4-5901-47e8-a961-70246e585c89', 'efca66f6-39f4-48d2-8220-c76b8af3ef0b', '12eb6ab6-b727-44fd-bc25-7e22e1de90e7', '69ca0eb5-d472-4dd7-8fe9-8f64644276f8'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Delete snapshot completed successfully. Sep 30 10:37:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-1b8b3e4d-72c9-4d70-b6d7-a8246ec91cc7 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-2abbf854-a151-4972-a4cf-0b6b7660674d-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] Creating offline snapshot c0dc669d-351b-44a9-bc6e-e9584937a126 of volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:37:39 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad091529-0316-4f69-8d72-f87fde428bea]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:39 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:39 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:39 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.425s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:39 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 1G Sep 30 10:37:39 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:40 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 1G" returned: 0 in 0.518s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:40 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 Sep 30 10:37:40 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:40 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126" returned: 0 in 0.359s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:40 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 is being set with open permissions: ugo+rw Sep 30 10:37:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:40 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 Sep 30 10:37:40 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:40 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126" returned: 0 in 0.273s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.718s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-40a8509b-97fc-400c-87cc-029554496d9e tempest-SnapshotsActionsTest-1760244896 None] Create snapshot completed successfully Sep 30 10:37:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-c0dc669d-351b-44a9-bc6e-e9584937a126-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-c0dc669d-351b-44a9-bc6e-e9584937a126-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-quobyte-c0dc669d-351b-44a9-bc6e-e9584937a126" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-c0dc669d-351b-44a9-bc6e-e9584937a126" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Deleting offline snapshot c0dc669d-351b-44a9-bc6e-e9584937a126 of volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:37:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] snapshot_file for this snap is: volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:37:41 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809fc84-b017-494c-95c7-1200289ff5a6]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:41 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 Sep 30 10:37:41 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:42 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126" returned: 0 in 0.424s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:42 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca834a65-b738-40c8-bfb4-5d8b93e85637]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:42 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:42 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:42 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.459s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:42 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 Sep 30 10:37:42 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:43 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126" returned: 0 in 0.504s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:43 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126 Sep 30 10:37:43 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:43 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.c0dc669d-351b-44a9-bc6e-e9584937a126" returned: 0 in 0.268s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-c0dc669d-351b-44a9-bc6e-e9584937a126" released by "_delete_snapshot" :: held 1.890s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" released by "delete_snapshot" :: held 1.936s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:43 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Created reservations ['4f1624c0-63c7-4b0f-bfb8-fa01d153945b', '57daa7c0-d5f5-427d-a9ba-7e0b582f82d4', '2d0b97f9-6fcc-4c4e-983c-fa00ae028086', 'd29cef27-fde5-46f8-b5e9-8c430f92fe43'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Delete snapshot completed successfully. Sep 30 10:37:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-80c8a876-ed63-4de9-a2ae-473ef8ec727f tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-c0dc669d-351b-44a9-bc6e-e9584937a126-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] Creating offline snapshot 4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 of volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:37:44 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[848072d3-bc43-4a9c-b66f-eab181d0255e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:44 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:44 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:44 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.431s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:44 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 1G Sep 30 10:37:44 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:45 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 1G" returned: 0 in 0.512s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:45 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 Sep 30 10:37:45 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:45 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8" returned: 0 in 0.332s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:45 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 is being set with open permissions: ugo+rw Sep 30 10:37:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:45 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 Sep 30 10:37:45 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:45 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8" returned: 0 in 0.272s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.684s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:45 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ef9dff50-b4eb-4bd2-8236-2327b5efef01 tempest-SnapshotsActionsTest-1760244896 None] Create snapshot completed successfully Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-4dc585e7-fc01-4857-8cf8-5b552a1a1fb8-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-4dc585e7-fc01-4857-8cf8-5b552a1a1fb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-quobyte-4dc585e7-fc01-4857-8cf8-5b552a1a1fb8" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-4dc585e7-fc01-4857-8cf8-5b552a1a1fb8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Deleting offline snapshot 4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 of volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] snapshot_file for this snap is: volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10efe8a-578a-4c74-b254-eec976591d38]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:46 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 Sep 30 10:37:46 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Flow 'volume_create_manager' (f3f9048a-712f-4e99-8b91-5c78ecd16996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03064e7-6d70-4572-a556-33c77e13738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03064e7-6d70-4572-a556-33c77e13738b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1601245244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d57914-d69d-431f-b796-792f43cd10f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9438d01c7c444bef9e08716b73f8843f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:47Z,use_quota=True,user_id='6b13f832818d4a9f8c2725af9f2976d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46868d0f-81aa-404d-abfd-bd4fd671b03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46868d0f-81aa-404d-abfd-bd4fd671b03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89261978-0959-4d11-a6a0-90e5fa411203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:46 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89261978-0959-4d11-a6a0-90e5fa411203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d57914-d69d-431f-b796-792f43cd10f2', 'volume_name': 'volume-83d57914-d69d-431f-b796-792f43cd10f2', 'volume_size': 2}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5473e7-5917-471f-b659-9acb32a91ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5473e7-5917-471f-b659-9acb32a91ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cd2bad-2a81-48b1-a2b9-89ec321352be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:46 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Volume 83d57914-d69d-431f-b796-792f43cd10f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d57914-d69d-431f-b796-792f43cd10f2', 'volume_size': 2} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1601245244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d57914-d69d-431f-b796-792f43cd10f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9438d01c7c444bef9e08716b73f8843f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:37:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:37:47Z,use_quota=True,user_id='6b13f832818d4a9f8c2725af9f2976d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Creating volume 83d57914-d69d-431f-b796-792f43cd10f2 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:37:46 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 2147483648 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8" returned: 0 in 0.446s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:46 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 2147483648 Sep 30 10:37:46 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e7813b-de0f-4135-849b-8c0883e9235b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:47 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:47 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:47 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.480s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:47 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 Sep 30 10:37:47 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:47 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 2147483648" returned: 0 in 0.688s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:47 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 Sep 30 10:37:47 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:47 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2" returned: 0 in 0.274s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cd2bad-2a81-48b1-a2b9-89ec321352be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d57914-d69d-431f-b796-792f43cd10f2', 'volume_size': 2}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8c0b63-a6c7-4725-b7a6-67e05e71ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:37:47 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Volume volume-83d57914-d69d-431f-b796-792f43cd10f2 (83d57914-d69d-431f-b796-792f43cd10f2): created successfully Sep 30 10:37:47 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8c0b63-a6c7-4725-b7a6-67e05e71ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Flow 'volume_create_manager' (f3f9048a-712f-4e99-8b91-5c78ecd16996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8" returned: 0 in 0.521s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:48 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0e690d9a-0503-4cd1-9459-97943f43a6b9 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Created volume successfully. Sep 30 10:37:48 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8 Sep 30 10:37:48 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:48 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.4dc585e7-fc01-4857-8cf8-5b552a1a1fb8" returned: 0 in 0.274s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-4dc585e7-fc01-4857-8cf8-5b552a1a1fb8" released by "_delete_snapshot" :: held 1.875s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" released by "delete_snapshot" :: held 1.910s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:48 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Created reservations ['774cf352-36e2-4d8b-bf28-d88e1ac1d38c', 'f61010ce-50ce-405e-a7cf-bb6d1e794a36', '926d54b1-6f85-4489-88c1-22736a7a0903', 'c73cf3c7-869f-4262-adfa-4f698d9a6448'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:48 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Delete snapshot completed successfully. Sep 30 10:37:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e1beb63e-d949-4f7f-9bc9-c146d6f0f890 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-4dc585e7-fc01-4857-8cf8-5b552a1a1fb8-delete_snapshot" released by "delete_snapshot" :: held 2.079s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] Creating offline snapshot baab3148-8b7b-4af4-868a-e4bc0652b026 of volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:37:48 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce75294-5deb-4075-adca-13fb80bb2665]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:48 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:48 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:49 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.361s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:49 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 1G Sep 30 10:37:49 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:49 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 1G" returned: 0 in 0.416s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:49 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 Sep 30 10:37:49 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:49 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026" returned: 0 in 0.296s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:49 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 is being set with open permissions: ugo+rw Sep 30 10:37:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:49 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 Sep 30 10:37:49 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:50 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026" returned: 0 in 0.253s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.441s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.192s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Creating offline snapshot b38edfdf-c3ea-4a37-83a9-01ffa6022210 of volume 83d57914-d69d-431f-b796-792f43cd10f2 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:37:50 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-05e9d7e5-eac7-4c30-879c-e3f251fd0b52 tempest-SnapshotsActionsTest-1760244896 None] Create snapshot completed successfully Sep 30 10:37:50 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f084ed-c728-4eea-9ab3-390373ff14b0]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:50 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 Sep 30 10:37:50 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:50 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2" returned: 0 in 0.354s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 2G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:50 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 2G Sep 30 10:37:50 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-baab3148-8b7b-4af4-868a-e4bc0652b026-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-baab3148-8b7b-4af4-868a-e4bc0652b026-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Acquiring lock "cinder-quobyte-baab3148-8b7b-4af4-868a-e4bc0652b026" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-baab3148-8b7b-4af4-868a-e4bc0652b026" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Deleting offline snapshot baab3148-8b7b-4af4-868a-e4bc0652b026 of volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:37:51 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] snapshot_file for this snap is: volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 2G" returned: 0 in 0.471s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83d57914-d69d-431f-b796-792f43cd10f2 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d42f7b-0065-4f69-8c75-533015f79a83]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:51 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83d57914-d69d-431f-b796-792f43cd10f2 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 Sep 30 10:37:51 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:51 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 Sep 30 10:37:51 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:51 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83d57914-d69d-431f-b796-792f43cd10f2 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210" returned: 0 in 0.301s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:51 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 is being set with open permissions: ugo+rw Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:51 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 Sep 30 10:37:51 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:51 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026" returned: 0 in 0.386s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f6d348-147a-4440-a991-a0309b9baf22]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:51 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:51 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:51 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210" returned: 0 in 0.254s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:51 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.info Sep 30 10:37:51 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:51 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.377s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:51 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:51 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.info" returned: 0 in 0.254s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:51 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.info is being set with open permissions: ugo+rw Sep 30 10:37:51 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:51 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.info Sep 30 10:37:51 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:52 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.info" returned: 0 in 0.254s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3d0e6684-8581-4ee3-b05d-0143968f1025 tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Create snapshot completed successfully Sep 30 10:37:52 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026" returned: 0 in 0.392s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:52 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026 Sep 30 10:37:52 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:52 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.baab3148-8b7b-4af4-868a-e4bc0652b026" returned: 0 in 0.247s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-baab3148-8b7b-4af4-868a-e4bc0652b026" released by "_delete_snapshot" :: held 1.524s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" released by "delete_snapshot" :: held 1.550s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:52 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Created reservations ['02a256c3-7e3d-434a-b422-f5fc4ad6fcbf', '572c9b6a-f6e5-4b1d-8023-6ab5688d13b9', '4e9d09a8-2d7e-4818-96a3-c8e656102033', 'f09a01c3-dfc7-42b6-ba60-bbbfe3fe81d9'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Delete snapshot completed successfully. Sep 30 10:37:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b0f261-566d-4893-b517-55870b9c00c0 tempest-SnapshotsActionsTest-836824593 None] Lock "cinder-baab3148-8b7b-4af4-868a-e4bc0652b026-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Acquiring lock "cinder-b38edfdf-c3ea-4a37-83a9-01ffa6022210-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "cinder-b38edfdf-c3ea-4a37-83a9-01ffa6022210-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Acquiring lock "cinder-quobyte-83d57914-d69d-431f-b796-792f43cd10f2" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "cinder-quobyte-83d57914-d69d-431f-b796-792f43cd10f2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Acquiring lock "cinder-quobyte-b38edfdf-c3ea-4a37-83a9-01ffa6022210" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "cinder-quobyte-b38edfdf-c3ea-4a37-83a9-01ffa6022210" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Deleting offline snapshot b38edfdf-c3ea-4a37-83a9-01ffa6022210 of volume 83d57914-d69d-431f-b796-792f43cd10f2 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] snapshot_file for this snap is: volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[38274b27-b648-44ce-8245-db8ff7712412]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:53 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 Sep 30 10:37:53 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "cinder-52b42395-8b26-4d77-b90d-c451d363e58a-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Lock "cinder-52b42395-8b26-4d77-b90d-c451d363e58a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "cinder-quobyte-52b42395-8b26-4d77-b90d-c451d363e58a" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Lock "cinder-quobyte-52b42395-8b26-4d77-b90d-c451d363e58a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Deleting offline snapshot 52b42395-8b26-4d77-b90d-c451d363e58a of volume 94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] snapshot_file for this snap is: volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b086a295-b762-4a89-9258-f786f405aa72]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:53 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:53 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:53 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210" returned: 0 in 0.441s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83d57914-d69d-431f-b796-792f43cd10f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e240b6-b488-462c-bdf8-84fd4f1a3310]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:54 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 Sep 30 10:37:54 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:54 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.391s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:37:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78b7f49-5672-4e04-88a4-88e1ee0c2809]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:54 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 Sep 30 10:37:54 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:54 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2" returned: 0 in 0.393s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:54 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 Sep 30 10:37:54 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:54 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" returned: 0 in 0.392s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:54 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:54 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:54 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210" returned: 0 in 0.395s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:54 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210 Sep 30 10:37:54 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:55 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.425s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:55 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2.b38edfdf-c3ea-4a37-83a9-01ffa6022210" returned: 0 in 0.283s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:55 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a Sep 30 10:37:55 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "cinder-quobyte-b38edfdf-c3ea-4a37-83a9-01ffa6022210" released by "_delete_snapshot" :: held 1.657s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "cinder-quobyte-83d57914-d69d-431f-b796-792f43cd10f2" released by "delete_snapshot" :: held 1.685s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Created reservations ['82f067ff-fb5a-4a65-9d56-449c6670cc00', '55c40d0c-b1e6-4ac6-b4b7-f7c640316734', '944b7c72-a131-4bf3-89f0-811d7de1849f', '2003a955-d3c4-4c83-895e-5caa48ca135e'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Delete snapshot completed successfully. Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7d49b717-a503-473c-b6e1-982a3d8aba8f tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "cinder-b38edfdf-c3ea-4a37-83a9-01ffa6022210-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:55 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570.52b42395-8b26-4d77-b90d-c451d363e58a" returned: 0 in 0.267s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Lock "cinder-quobyte-52b42395-8b26-4d77-b90d-c451d363e58a" released by "_delete_snapshot" :: held 1.602s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" released by "delete_snapshot" :: held 1.628s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Created reservations ['fadfc45d-1b5c-4d6c-9b9d-58cf2866d713', 'e855a553-f34d-47bb-bf57-7062c4a571a2', 'b4cb5c79-6bca-4d8a-80ac-ade84778023f', 'fa2d5600-2f39-4acd-bf20-02fa069c30ad'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Delete snapshot completed successfully. Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c2f5c01e-90d8-4673-a219-8ebd2aa92d76 tempest-SnapshotsActionsTest-1760244896 None] Lock "cinder-52b42395-8b26-4d77-b90d-c451d363e58a-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Acquiring lock "cinder-83d57914-d69d-431f-b796-792f43cd10f2-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "cinder-83d57914-d69d-431f-b796-792f43cd10f2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Acquiring lock "cinder-quobyte-83d57914-d69d-431f-b796-792f43cd10f2" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "cinder-quobyte-83d57914-d69d-431f-b796-792f43cd10f2" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f7d063-d575-498e-91df-5d625cfeb55c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:55 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 Sep 30 10:37:55 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "cinder-94ab4ff8-1d5f-47c8-8517-dc1539e5c570-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Lock "cinder-94ab4ff8-1d5f-47c8-8517-dc1539e5c570-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eddd0d-330d-4541-a604-e7405b275e39]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:56 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:56 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 Sep 30 10:37:56 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2" returned: 0 in 0.483s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:56 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2 Sep 30 10:37:56 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:56 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" returned: 0 in 0.513s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:56 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570 Sep 30 10:37:56 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:56 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-83d57914-d69d-431f-b796-792f43cd10f2" returned: 0 in 0.440s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "cinder-quobyte-83d57914-d69d-431f-b796-792f43cd10f2" released by "delete_volume" :: held 1.015s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Created reservations ['3da27bd7-efb1-41b9-b5b5-c31e143167e5', '9c9cdd8f-3b81-4962-b1f2-ec033398cc58', '373ae3ed-ba6b-4536-8a06-db0100e0848c', '7b9291fd-a073-4a03-8231-cdbe12404c99'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:56 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" returned: 0 in 0.317s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:56 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:37:56 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Lock "cinder-quobyte-94ab4ff8-1d5f-47c8-8517-dc1539e5c570" released by "delete_volume" :: held 0.913s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Created reservations ['db5fbdd0-0089-4d21-870f-40cc18a5f281', '9872316a-ca85-4c32-9a30-0ba09b061f10', 'e48bf830-a70e-4bc3-aac0-06321585d3a0', 'adac7a11-4789-4184-bd46-91ab7f679751'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:37:57 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:37:57 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:37:57 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.298s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:37:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Deleted volume successfully. Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-96cdfe6f-332d-4708-aa48-2b59460c1b3d tempest-VolumesSnapshotNegativeTestJSON-333537816 None] Lock "cinder-83d57914-d69d-431f-b796-792f43cd10f2-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:57 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.271s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:37:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Deleted volume successfully. Sep 30 10:37:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-153e469c-e85d-427b-9de2-9377fb74a0f0 tempest-SnapshotsActionsTest-1760244896 None] Lock "cinder-94ab4ff8-1d5f-47c8-8517-dc1539e5c570-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:37:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-31b2150b-f13f-4153-b021-cf6bef02e5f9 req-5748b74e-84cc-4a8f-ab20-18667f991c2a tempest-TestShelveInstance-935076481 None] Terminate volume connection completed successfully. Sep 30 10:37:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-31b2150b-f13f-4153-b021-cf6bef02e5f9 req-5748b74e-84cc-4a8f-ab20-18667f991c2a tempest-TestShelveInstance-935076481 None] Deleting attachment 9adce04d-8215-42a4-ba58-e956b54e34d8. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:38:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-8b304597-e6be-4ffb-93a4-39aa1a90b678 req-76934dbb-659a-47e7-968c-2d2a0da8e3b9 tempest-TestShelveInstance-935076481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-8b304597-e6be-4ffb-93a4-39aa1a90b678 req-76934dbb-659a-47e7-968c-2d2a0da8e3b9 tempest-TestShelveInstance-935076481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-8b304597-e6be-4ffb-93a4-39aa1a90b678 req-76934dbb-659a-47e7-968c-2d2a0da8e3b9 tempest-TestShelveInstance-935076481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-8b304597-e6be-4ffb-93a4-39aa1a90b678 req-76934dbb-659a-47e7-968c-2d2a0da8e3b9 tempest-TestShelveInstance-935076481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-86c9243c-ae95-49fb-94a7-534000276433', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ff67e7d-22d0-4c90-8d11-fa695f2536fa', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:38:02 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-8b304597-e6be-4ffb-93a4-39aa1a90b678 req-76934dbb-659a-47e7-968c-2d2a0da8e3b9 tempest-TestShelveInstance-935076481 None] attachment_update completed successfully. Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Flow 'volume_create_manager' (7e6dc8ef-91b9-453e-98b1-bd58d90f35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb2c8ab-33b6-4055-b284-7e8ded2577eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb2c8ab-33b6-4055-b284-7e8ded2577eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1859124441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979efd1899b0476593f11f6f73d5a7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:06Z,use_quota=True,user_id='9e31439526004ea0b1aaea175565bd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096a519d-fec8-43c4-8d4c-6900d760f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096a519d-fec8-43c4-8d4c-6900d760f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803b3c20-352d-491a-980c-ee84fe4e43dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803b3c20-352d-491a-980c-ee84fe4e43dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c', 'volume_name': 'volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868b79d5-c4d4-4f63-bd23-32dd1ebfbd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868b79d5-c4d4-4f63-bd23-32dd1ebfbd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d6cf32-9eba-4b78-8722-f339e0b71331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:06 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Volume 2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c', 'volume_size': 1} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1859124441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979efd1899b0476593f11f6f73d5a7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:06Z,use_quota=True,user_id='9e31439526004ea0b1aaea175565bd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Creating volume 2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:38:06 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:38:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:06 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c 1073741824 Sep 30 10:38:06 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:07 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c 1073741824" returned: 0 in 0.755s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:07 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c Sep 30 10:38:07 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:07 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c" returned: 0 in 0.497s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:38:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d6cf32-9eba-4b78-8722-f339e0b71331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8ece43-1878-4325-81b0-de5364c7afdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:07 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Volume volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c (2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c): created successfully Sep 30 10:38:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8ece43-1878-4325-81b0-de5364c7afdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Flow 'volume_create_manager' (7e6dc8ef-91b9-453e-98b1-bd58d90f35b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:07 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ce8ad662-01ce-48f4-872e-8f51226c51fb tempest-VolumesServicesTestJSON-65704591 None] Created volume successfully. Sep 30 10:38:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Acquiring lock "cinder-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Lock "cinder-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Acquiring lock "cinder-quobyte-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Lock "cinder-quobyte-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:08 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[10841c14-d3df-4998-b3d5-3ba04dcbbe1f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:08 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c Sep 30 10:38:08 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:09 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c" returned: 0 in 0.560s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:09 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c Sep 30 10:38:09 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:09 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c" returned: 0 in 0.491s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Lock "cinder-quobyte-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c" released by "delete_volume" :: held 1.154s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Created reservations ['b5637f33-f68f-4515-b6ab-7338c6a64b6a', 'ab2f9386-aa84-4527-a419-eaab5036c223', '9fd7a41b-01ce-4e15-9cd5-910f913c9936', 'b531047b-bd1f-4704-bde7-30adce7415bd'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:09 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:38:09 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:10 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.547s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:10 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:38:10 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Deleted volume successfully. Sep 30 10:38:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e38d0225-c410-4c02-8ae7-1b128effae81 tempest-VolumesServicesTestJSON-65704591 None] Lock "cinder-2e3172eb-7706-4ee4-b1a4-bbb6ca9fc39c-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=97,cinder:UPDATE=115,cinder:DELETE=5,cinder:INSERT=27 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=107,cinder:INSERT=31,cinder:UPDATE=101,cinder:DELETE=11 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Flow 'volume_create_manager' (c310ea45-94f9-4f20-aafb-577261fab9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e42d5c8-4aa1-4f55-ba06-9415e20a284f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e42d5c8-4aa1-4f55-ba06-9415e20a284f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1930085629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d470003a-eccc-49b2-a1eb-6137fb805d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf35d54e488c4f31ac64d2bc9f1be3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:20Z,use_quota=True,user_id='8db6e19db57b47db851078f9cedf6576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5b8b647-c4b3-4c4e-9ee7-834a29e06988),volume_type_id=e5b8b647-c4b3-4c4e-9ee7-834a29e06988)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b70049-3d90-4d8d-9590-8ae977c54c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b70049-3d90-4d8d-9590-8ae977c54c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d334fd1d-3c48-4572-af51-1b59bb1d68bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d334fd1d-3c48-4572-af51-1b59bb1d68bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd470003a-eccc-49b2-a1eb-6137fb805d64', 'volume_name': 'volume-d470003a-eccc-49b2-a1eb-6137fb805d64', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8214d55-74d1-4356-885a-8b736d67e963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8214d55-74d1-4356-885a-8b736d67e963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a25dd6a-9d57-4438-bf49-0100ab631d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:19 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Volume d470003a-eccc-49b2-a1eb-6137fb805d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d470003a-eccc-49b2-a1eb-6137fb805d64', 'volume_size': 1} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1930085629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d470003a-eccc-49b2-a1eb-6137fb805d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf35d54e488c4f31ac64d2bc9f1be3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:20Z,use_quota=True,user_id='8db6e19db57b47db851078f9cedf6576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5b8b647-c4b3-4c4e-9ee7-834a29e06988),volume_type_id=e5b8b647-c4b3-4c4e-9ee7-834a29e06988)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Creating volume d470003a-eccc-49b2-a1eb-6137fb805d64 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:38:19 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:38:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:19 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64 1073741824 Sep 30 10:38:19 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:20 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64 1073741824" returned: 0 in 0.603s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:20 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64 Sep 30 10:38:20 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:20 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64" returned: 0 in 0.364s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:38:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a25dd6a-9d57-4438-bf49-0100ab631d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d470003a-eccc-49b2-a1eb-6137fb805d64', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69170150-78be-4959-a9a6-6e77a71b9e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:20 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Volume volume-d470003a-eccc-49b2-a1eb-6137fb805d64 (d470003a-eccc-49b2-a1eb-6137fb805d64): created successfully Sep 30 10:38:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69170150-78be-4959-a9a6-6e77a71b9e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Flow 'volume_create_manager' (c310ea45-94f9-4f20-aafb-577261fab9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8ea070d3-b44e-4a0f-bf90-86d3d7c1dae1 tempest-VolumeTypesAccessTest-1840640761 None] Created volume successfully. Sep 30 10:38:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Acquiring lock "cinder-d470003a-eccc-49b2-a1eb-6137fb805d64-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Lock "cinder-d470003a-eccc-49b2-a1eb-6137fb805d64-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Acquiring lock "cinder-quobyte-d470003a-eccc-49b2-a1eb-6137fb805d64" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Lock "cinder-quobyte-d470003a-eccc-49b2-a1eb-6137fb805d64" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:22 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5768404-74d5-4c53-a018-705587370e2d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:22 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64 Sep 30 10:38:22 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:22 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64" returned: 0 in 0.458s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:22 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64 Sep 30 10:38:22 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:22 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d470003a-eccc-49b2-a1eb-6137fb805d64" returned: 0 in 0.280s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Lock "cinder-quobyte-d470003a-eccc-49b2-a1eb-6137fb805d64" released by "delete_volume" :: held 0.806s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:23 devstack cinder-volume[87013]: WARNING cinder.quota [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1479660011 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1479660011, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:38:23 devstack cinder-volume[87013]: WARNING cinder.quota [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1479660011 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1479660011, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:38:23 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Created reservations ['64719d38-3d2c-47e0-b1ac-af8b6262541a', 'e65e9dfc-32c4-4552-b7e4-be1dd1836fae', '274afaba-7656-48d4-be38-71561990169f', 'f31b1f1f-580e-426a-936d-4aea58ad4f59'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:38:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:23 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:38:23 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:23 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.382s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:23 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:38:23 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Deleted volume successfully. Sep 30 10:38:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-8917289c-6176-49fd-bbe1-cd1e7a622af9 tempest-VolumeTypesAccessTest-1840640761 None] Lock "cinder-d470003a-eccc-49b2-a1eb-6137fb805d64-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Flow 'volume_create_manager' (330f025d-ae4c-4b9e-b0df-33c463233dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c141ed0-c035-4e89-8944-fe1279b0ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c141ed0-c035-4e89-8944-fe1279b0ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1059411847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac25fea5-b54a-43b6-9b05-2bd485f4f902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a499c87b78148799c931af4d6693743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:29Z,use_quota=True,user_id='dab1a033d3fd44319055bf6de3ff3892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a927735-77fb-4dc4-ac39-85871caac36a),volume_type_id=8a927735-77fb-4dc4-ac39-85871caac36a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3168c907-ec82-44fc-a0d4-75aa7cccc363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3168c907-ec82-44fc-a0d4-75aa7cccc363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db36e7f2-6c2e-4ba2-b4b5-69293c95ed37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db36e7f2-6c2e-4ba2-b4b5-69293c95ed37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac25fea5-b54a-43b6-9b05-2bd485f4f902', 'volume_name': 'volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63188267-c646-4240-88d8-cef2bedc9cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63188267-c646-4240-88d8-cef2bedc9cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86d7c03-d231-4173-bfa6-df68da7bd76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:29 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Volume ac25fea5-b54a-43b6-9b05-2bd485f4f902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902', 'volume_size': 1} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1059411847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac25fea5-b54a-43b6-9b05-2bd485f4f902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a499c87b78148799c931af4d6693743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:29Z,use_quota=True,user_id='dab1a033d3fd44319055bf6de3ff3892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a927735-77fb-4dc4-ac39-85871caac36a),volume_type_id=8a927735-77fb-4dc4-ac39-85871caac36a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Creating volume ac25fea5-b54a-43b6-9b05-2bd485f4f902 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:38:29 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:29 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902 1073741824 Sep 30 10:38:29 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Flow 'volume_create_manager' (e7f47661-b4d4-4dff-b227-da03752b1e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a045629c-bb01-4328-8891-fa12b0e6b2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a045629c-bb01-4328-8891-fa12b0e6b2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1610127965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e8d857-d5a0-4ca2-b2e6-9557a76832d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a499c87b78148799c931af4d6693743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:29Z,use_quota=True,user_id='dab1a033d3fd44319055bf6de3ff3892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf35cd10-a886-4164-bb90-738be3e66cdd),volume_type_id=cf35cd10-a886-4164-bb90-738be3e66cdd)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ee5d50-d459-495f-a337-28a22d74de12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ee5d50-d459-495f-a337-28a22d74de12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17a99db-aaaf-46fd-a598-cca7d2b33c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17a99db-aaaf-46fd-a598-cca7d2b33c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e8d857-d5a0-4ca2-b2e6-9557a76832d3', 'volume_name': 'volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7f15f7-6064-48bf-ad77-ed97103d240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7f15f7-6064-48bf-ad77-ed97103d240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c454ea-49cd-4d57-b182-4cd941c783c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:29 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Volume d4e8d857-d5a0-4ca2-b2e6-9557a76832d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3', 'volume_size': 1} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:29 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902 1073741824" returned: 0 in 0.586s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:29 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902 Sep 30 10:38:29 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:30 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902" returned: 0 in 0.286s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.441s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1610127965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e8d857-d5a0-4ca2-b2e6-9557a76832d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a499c87b78148799c931af4d6693743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:29Z,use_quota=True,user_id='dab1a033d3fd44319055bf6de3ff3892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf35cd10-a886-4164-bb90-738be3e66cdd),volume_type_id=cf35cd10-a886-4164-bb90-738be3e66cdd)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Creating volume d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:38:30 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86d7c03-d231-4173-bfa6-df68da7bd76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:30 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 1073741824 Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85e9ffa-50dc-4113-a63d-a804924b012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:30 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:30 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Volume volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902 (ac25fea5-b54a-43b6-9b05-2bd485f4f902): created successfully Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85e9ffa-50dc-4113-a63d-a804924b012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Flow 'volume_create_manager' (330f025d-ae4c-4b9e-b0df-33c463233dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-bea83107-2457-45ac-9bf1-7dc6136fb45c tempest-TestInstancesWithCinderVolumes-1168861503 None] Created volume successfully. Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Flow 'volume_create_manager' (8186d094-4a76-4355-9a22-3f792ac01338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf0cce5-b447-43df-927b-86a9ef8577c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf0cce5-b447-43df-927b-86a9ef8577c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1949740562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0d96cd-1fd4-419b-8523-9480d007a30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a499c87b78148799c931af4d6693743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:30Z,use_quota=True,user_id='dab1a033d3fd44319055bf6de3ff3892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ec48190-d3ee-480a-b287-4512163c7340),volume_type_id=1ec48190-d3ee-480a-b287-4512163c7340)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f79f8fe-fef7-4e2a-bec8-788ddb85e727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f79f8fe-fef7-4e2a-bec8-788ddb85e727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f59eee6-ac8f-4569-a232-b675f97bddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.image.glance [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Creating Keystone auth plugin from conf {{(pid=87013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 10:38:30 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 1073741824" returned: 0 in 0.522s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:30 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 Sep 30 10:38:30 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f59eee6-ac8f-4569-a232-b675f97bddc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be0d96cd-1fd4-419b-8523-9480d007a30a', 'volume_name': 'volume-be0d96cd-1fd4-419b-8523-9480d007a30a', 'volume_size': 1, 'image_id': '7820012f-b5bb-40d5-87ab-0923453c7e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7820012f-b5bb-40d5-87ab-0923453c7e10', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--107137689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8a499c87b78148799c931af4d6693743', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7820012f-b5bb-40d5-87ab-0923453c7e10', 'created_at': datetime.datetime(2026, 9, 30, 8, 38, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 38, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7820012f-b5bb-40d5-87ab-0923453c7e10/file', 'properties': {}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3b077b-21da-49b0-8ea5-3e7034201ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3b077b-21da-49b0-8ea5-3e7034201ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76a5a3e-6ee9-47bd-99a8-f12cbd1e6e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:30 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Volume be0d96cd-1fd4-419b-8523-9480d007a30a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be0d96cd-1fd4-419b-8523-9480d007a30a', 'volume_size': 1, 'image_id': '7820012f-b5bb-40d5-87ab-0923453c7e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7820012f-b5bb-40d5-87ab-0923453c7e10', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--107137689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8a499c87b78148799c931af4d6693743', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7820012f-b5bb-40d5-87ab-0923453c7e10', 'created_at': datetime.datetime(2026, 9, 30, 8, 38, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 38, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7820012f-b5bb-40d5-87ab-0923453c7e10/file', 'properties': {}}, 'image_service': } Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Trying to clone be0d96cd-1fd4-419b-8523-9480d007a30a from image 7820012f-b5bb-40d5-87ab-0923453c7e10 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7820012f-b5bb-40d5-87ab-0923453c7e10', 'metadata': {}}]). {{(pid=87013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 10:38:30 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3" returned: 0 in 0.258s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c454ea-49cd-4d57-b182-4cd941c783c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3dab8c7-f37e-40cb-94ca-fabab5535091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:30 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Volume volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 (d4e8d857-d5a0-4ca2-b2e6-9557a76832d3): created successfully Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3dab8c7-f37e-40cb-94ca-fabab5535091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Flow 'volume_create_manager' (e7f47661-b4d4-4dff-b227-da03752b1e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-5bd75dac-21aa-4bfb-9f51-b358f1085f28 tempest-TestInstancesWithCinderVolumes-1168861503 None] Created volume successfully. Sep 30 10:38:34 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD, size 20.69 MB, duration 3.80 sec {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 10:38:34 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Image download 20.69 MB at 5.45 MB/s Sep 30 10:38:34 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0603fcac-0534-4876-8d66-313112a15b8e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:34 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD Sep 30 10:38:34 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:34 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:34 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Temporary image 7820012f-b5bb-40d5-87ab-0923453c7e10 is fetched for user dab1a033d3fd44319055bf6de3ff3892. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee58b50-4d96-47de-b8ac-ee7da0b70865]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:35 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD Sep 30 10:38:35 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:35 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1949740562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0d96cd-1fd4-419b-8523-9480d007a30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a499c87b78148799c931af4d6693743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:30Z,use_quota=True,user_id='dab1a033d3fd44319055bf6de3ff3892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ec48190-d3ee-480a-b287-4512163c7340),volume_type_id=1ec48190-d3ee-480a-b287-4512163c7340)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Creating volume be0d96cd-1fd4-419b-8523-9480d007a30a {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:38:35 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:35 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a 1073741824 Sep 30 10:38:35 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:35 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a 1073741824" returned: 0 in 0.461s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:35 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a Sep 30 10:38:35 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:36 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a" returned: 0 in 0.241s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Attempting download of 7820012f-b5bb-40d5-87ab-0923453c7e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/7820012f-b5bb-40d5-87ab-0923453c7e10', 'metadata': {}}])) to volume be0d96cd-1fd4-419b-8523-9480d007a30a. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[abef39fb-b2e5-4456-8aab-76b0d234c3c4]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7820012f-b5bb-40d5-87ab-0923453c7e10_yua94kk7 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:36 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7820012f-b5bb-40d5-87ab-0923453c7e10_yua94kk7 Sep 30 10:38:36 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:36 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7820012f-b5bb-40d5-87ab-0923453c7e10_yua94kk7" returned: 0 in 0.346s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7820012f-b5bb-40d5-87ab-0923453c7e10_yua94kk7 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:36 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7820012f-b5bb-40d5-87ab-0923453c7e10_yua94kk7 Sep 30 10:38:36 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:36 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7820012f-b5bb-40d5-87ab-0923453c7e10_yua94kk7" returned: 1 in 0.334s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7820012f-b5bb-40d5-87ab-0923453c7e10_yua94kk7' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b955ab-80a0-4796-8ec6-406344bea7fd]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:37 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD Sep 30 10:38:37 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:37 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:38:37 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:37 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:37 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.264s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] 7820012f-b5bb-40d5-87ab-0923453c7e10 was qcow2, converting to qcow2 {{(pid=87013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:38:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:38:37 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a Sep 30 10:38:37 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:39 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a" returned: 0 in 1.965s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7820012f-b5bb-40d5-87ab-0923453c7e10_2b40m3ucdevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:38:39 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Converted 112.00 MB image at 56.93 MB/s Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:39 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a 1G Sep 30 10:38:39 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:39 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a 1G" returned: 0 in 0.343s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Downloaded image 7820012f-b5bb-40d5-87ab-0923453c7e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/7820012f-b5bb-40d5-87ab-0923453c7e10', 'metadata': {}}])) to volume be0d96cd-1fd4-419b-8523-9480d007a30a successfully. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Temporary image 7820012f-b5bb-40d5-87ab-0923453c7e10 for user dab1a033d3fd44319055bf6de3ff3892 is deleted. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Marking volume be0d96cd-1fd4-419b-8523-9480d007a30a as bootable. {{(pid=87013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Copying metadata from image 7820012f-b5bb-40d5-87ab-0923453c7e10 to be0d96cd-1fd4-419b-8523-9480d007a30a. {{(pid=87013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Creating volume glance metadata for volume be0d96cd-1fd4-419b-8523-9480d007a30a backed by image 7820012f-b5bb-40d5-87ab-0923453c7e10 with: {'image_id': '7820012f-b5bb-40d5-87ab-0923453c7e10', 'image_name': 'tempest-scenario-img--107137689', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76a5a3e-6ee9-47bd-99a8-f12cbd1e6e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0d96cd-1fd4-419b-8523-9480d007a30a', 'volume_size': 1, 'image_id': '7820012f-b5bb-40d5-87ab-0923453c7e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7820012f-b5bb-40d5-87ab-0923453c7e10', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--107137689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8a499c87b78148799c931af4d6693743', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7820012f-b5bb-40d5-87ab-0923453c7e10', 'created_at': datetime.datetime(2026, 9, 30, 8, 38, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 38, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7820012f-b5bb-40d5-87ab-0923453c7e10/file', 'properties': {}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f417f3-d778-4190-9210-55325ef362de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:39 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Volume volume-be0d96cd-1fd4-419b-8523-9480d007a30a (be0d96cd-1fd4-419b-8523-9480d007a30a): created successfully Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f417f3-d778-4190-9210-55325ef362de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Flow 'volume_create_manager' (8186d094-4a76-4355-9a22-3f792ac01338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-dd97d992-e192-4012-8dad-3172bf2ec42d tempest-TestInstancesWithCinderVolumes-1168861503 None] Created volume successfully. Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Flow 'volume_create_manager' (13f97e1c-bed4-4d07-9c64-af4c19e6a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f52bec-8d9a-48ec-8da6-a68196dcea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f52bec-8d9a-48ec-8da6-a68196dcea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-458332843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453a41d0-3612-4b92-bdfc-85616689a50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23b0bdb044241d4ac1563993689877e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:40Z,use_quota=True,user_id='b30ca4aa69fc44ab9ee7e845c3cf0a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d1ebbe-7a8a-437e-8769-c45125faa30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d1ebbe-7a8a-437e-8769-c45125faa30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408ae127-d1d2-4753-8ce8-9715f804f122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408ae127-d1d2-4753-8ce8-9715f804f122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453a41d0-3612-4b92-bdfc-85616689a50c', 'volume_name': 'volume-453a41d0-3612-4b92-bdfc-85616689a50c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd71b89-8a87-46ed-bffa-239467cf43c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd71b89-8a87-46ed-bffa-239467cf43c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56041248-7dfd-4d45-a484-d95131964a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:40 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Volume 453a41d0-3612-4b92-bdfc-85616689a50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453a41d0-3612-4b92-bdfc-85616689a50c', 'volume_size': 1} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-458332843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453a41d0-3612-4b92-bdfc-85616689a50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23b0bdb044241d4ac1563993689877e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:40Z,use_quota=True,user_id='b30ca4aa69fc44ab9ee7e845c3cf0a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Creating volume 453a41d0-3612-4b92-bdfc-85616689a50c {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:38:40 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:40 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c 1073741824 Sep 30 10:38:40 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:40 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c 1073741824" returned: 0 in 0.437s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:40 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c Sep 30 10:38:40 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:40 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c" returned: 0 in 0.255s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56041248-7dfd-4d45-a484-d95131964a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453a41d0-3612-4b92-bdfc-85616689a50c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1dc200-b169-4550-b745-da834047284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:40 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Volume volume-453a41d0-3612-4b92-bdfc-85616689a50c (453a41d0-3612-4b92-bdfc-85616689a50c): created successfully Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1dc200-b169-4550-b745-da834047284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Flow 'volume_create_manager' (13f97e1c-bed4-4d07-9c64-af4c19e6a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-175b7bf2-a5a8-4912-baba-d2fc8c1abcd9 tempest-VolumesMetadataTest-514815283 None] Created volume successfully. Sep 30 10:38:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Acquiring lock "cinder-453a41d0-3612-4b92-bdfc-85616689a50c-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Lock "cinder-453a41d0-3612-4b92-bdfc-85616689a50c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Acquiring lock "cinder-quobyte-453a41d0-3612-4b92-bdfc-85616689a50c" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Lock "cinder-quobyte-453a41d0-3612-4b92-bdfc-85616689a50c" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:41 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[37075b27-99eb-4219-881a-4ee314d0278a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:42 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c Sep 30 10:38:42 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:42 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c" returned: 0 in 0.425s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:42 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c Sep 30 10:38:42 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:42 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-453a41d0-3612-4b92-bdfc-85616689a50c" returned: 0 in 0.296s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Lock "cinder-quobyte-453a41d0-3612-4b92-bdfc-85616689a50c" released by "delete_volume" :: held 0.770s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Created reservations ['dda45dba-5ea4-4866-97be-a34b961ed8e3', 'a90aa5dd-9801-448f-a2ec-fc045309e3c7', '0c632ed1-e764-49ec-85e9-c7a0134c6b55', '34978601-53db-4453-a0e4-dce43da1c729'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:42 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:38:42 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:43 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.260s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:43 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:38:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Deleted volume successfully. Sep 30 10:38:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44c2a83b-1d40-41dd-b9d5-340657ab5f9c tempest-VolumesMetadataTest-514815283 None] Lock "cinder-453a41d0-3612-4b92-bdfc-85616689a50c-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-e95b2a9c-c323-4285-a7ad-5f325212e82f req-be3583fa-0745-40a6-9743-e495eed93ef3 tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-e95b2a9c-c323-4285-a7ad-5f325212e82f req-be3583fa-0745-40a6-9743-e495eed93ef3 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-e95b2a9c-c323-4285-a7ad-5f325212e82f req-be3583fa-0745-40a6-9743-e495eed93ef3 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-e95b2a9c-c323-4285-a7ad-5f325212e82f req-be3583fa-0745-40a6-9743-e495eed93ef3 tempest-TestInstancesWithCinderVolumes-1168861503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb', 'name': 'volume-be0d96cd-1fd4-419b-8523-9480d007a30a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a55a5d49-7fa2-443c-8e28-929c7f1b3268', 'enforce_multipath': True} {{(pid=87013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 10:38:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-e95b2a9c-c323-4285-a7ad-5f325212e82f req-be3583fa-0745-40a6-9743-e495eed93ef3 tempest-TestInstancesWithCinderVolumes-1168861503 None] attachment_update completed successfully. Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Flow 'volume_create_manager' (a5281d7e-200f-4dba-9bfc-4f0b1f4aebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69fbe17-33dd-4746-a0f3-d483b8a116f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69fbe17-33dd-4746-a0f3-d483b8a116f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-473174314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85058522-427e-40d2-aae9-a8378a5963f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d90c36d057e43219fd3d3ef63a24dd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:50Z,use_quota=True,user_id='ef6171cda5ff4e01ae0a598d7398524a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594594ac-b053-4850-95e3-ad2082d115cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594594ac-b053-4850-95e3-ad2082d115cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4e6faf-c41a-4900-a5e2-e4861e485df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4e6faf-c41a-4900-a5e2-e4861e485df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85058522-427e-40d2-aae9-a8378a5963f2', 'volume_name': 'volume-85058522-427e-40d2-aae9-a8378a5963f2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a7706f-40b4-402a-a5c0-625df7734e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a7706f-40b4-402a-a5c0-625df7734e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6ea592-22d2-42af-9c2e-8168856b9693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:49 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Volume 85058522-427e-40d2-aae9-a8378a5963f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85058522-427e-40d2-aae9-a8378a5963f2', 'volume_size': 1} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-473174314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85058522-427e-40d2-aae9-a8378a5963f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d90c36d057e43219fd3d3ef63a24dd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:50Z,use_quota=True,user_id='ef6171cda5ff4e01ae0a598d7398524a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Creating volume 85058522-427e-40d2-aae9-a8378a5963f2 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:38:49 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:38:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:49 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2 1073741824 Sep 30 10:38:49 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:50 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2 1073741824" returned: 0 in 0.763s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:50 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2 Sep 30 10:38:50 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:51 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2" returned: 0 in 0.330s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6ea592-22d2-42af-9c2e-8168856b9693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85058522-427e-40d2-aae9-a8378a5963f2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac145a7-b91b-4a9d-b5b4-5a4adcd69ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:51 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Volume volume-85058522-427e-40d2-aae9-a8378a5963f2 (85058522-427e-40d2-aae9-a8378a5963f2): created successfully Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac145a7-b91b-4a9d-b5b4-5a4adcd69ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Flow 'volume_create_manager' (a5281d7e-200f-4dba-9bfc-4f0b1f4aebd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:51 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c8fe7d8c-df35-4599-be16-1f7918155220 tempest-VolumesTransfersV357Test-1177374056 None] Created volume successfully. Sep 30 10:38:51 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-e95b2a9c-c323-4285-a7ad-5f325212e82f req-e24602a2-8be6-47c8-95d0-49bb9c45f6d8 tempest-TestInstancesWithCinderVolumes-1168861503 None] Terminate volume connection completed successfully. Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-e95b2a9c-c323-4285-a7ad-5f325212e82f req-e24602a2-8be6-47c8-95d0-49bb9c45f6d8 tempest-TestInstancesWithCinderVolumes-1168861503 None] Deleting attachment a55a5d49-7fa2-443c-8e28-929c7f1b3268. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:38:51 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-44cdf323-9183-40d9-897f-eecbc758ee59 tempest-TestShelveInstance-935076481 None] Terminate volume connection completed successfully. Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-44cdf323-9183-40d9-897f-eecbc758ee59 tempest-TestShelveInstance-935076481 None] Deleting attachment 1ff67e7d-22d0-4c90-8d11-fa695f2536fa. {{(pid=87013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Acquiring lock "cinder-86c9243c-ae95-49fb-94a7-534000276433-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Lock "cinder-86c9243c-ae95-49fb-94a7-534000276433-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Acquiring lock "cinder-quobyte-86c9243c-ae95-49fb-94a7-534000276433" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Lock "cinder-quobyte-86c9243c-ae95-49fb-94a7-534000276433" acquired by "delete_volume" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6288beb3-4607-4176-9c11-10e115929c3b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:51 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 Sep 30 10:38:51 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:52 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433" returned: 0 in 0.586s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:52 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433 Sep 30 10:38:52 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:52 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-86c9243c-ae95-49fb-94a7-534000276433" returned: 0 in 0.349s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Lock "cinder-quobyte-86c9243c-ae95-49fb-94a7-534000276433" released by "delete_volume" :: held 0.997s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG cinder.quota [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Created reservations ['1028d993-cf4e-42a6-9a2a-0348836243b1', 'b262bb7f-3671-4763-9d92-b7b0bf3496aa', '1c7d8886-7c51-47bf-9ef6-17dd1e443007', '6c81b514-1286-46f1-bcce-78e08f394106'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:38:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-773054c4-ad85-479c-b94c-7f6cad9d842c tempest-VolumesTransfersV357Test-715829852 None] Transfer volume completed successfully. Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:52 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:38:52 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:53 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.348s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:53 devstack cinder-volume[87013]: DEBUG cinder.manager [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:38:53 devstack cinder-volume[87013]: INFO cinder.volume.manager [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Deleted volume successfully. Sep 30 10:38:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [req-63842821-fbbf-48ba-a106-b2c3b2be1b77 req-45ab8ce9-54a7-40e0-b12d-6247a307a947 tempest-TestShelveInstance-935076481 None] Lock "cinder-86c9243c-ae95-49fb-94a7-534000276433-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Acquiring lock "cinder-85058522-427e-40d2-aae9-a8378a5963f2-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Lock "cinder-85058522-427e-40d2-aae9-a8378a5963f2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Acquiring lock "cinder-quobyte-85058522-427e-40d2-aae9-a8378a5963f2" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:53 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Lock "cinder-quobyte-85058522-427e-40d2-aae9-a8378a5963f2" acquired by "delete_volume" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:53 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[47936658-ae5d-41b6-b61b-23bcc0317dc6]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:53 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2 Sep 30 10:38:53 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:54 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2" returned: 0 in 0.384s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:54 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2 Sep 30 10:38:54 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:54 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-85058522-427e-40d2-aae9-a8378a5963f2" returned: 0 in 0.310s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Lock "cinder-quobyte-85058522-427e-40d2-aae9-a8378a5963f2" released by "delete_volume" :: held 0.749s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Created reservations ['2d47cb47-2c96-4dd2-a396-573a34083c10', '28d2a693-bb80-4f53-9c86-700a3a51b5ac', '565f7800-0860-4c21-b75a-3d6fb2f5e1cf', '93fce6e4-36c5-4148-b6ea-04dbc2144f44'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:54 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:38:54 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:54 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.349s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:38:54 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Deleted volume successfully. Sep 30 10:38:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bd4a109c-3747-4ee0-a76c-ac312a8d2103 tempest-VolumesTransfersV357Test-891631247 None] Lock "cinder-85058522-427e-40d2-aae9-a8378a5963f2-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Flow 'volume_create_manager' (70511b27-ae7d-41ba-bb92-3a86e1f81fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be6b641-610f-465b-98d8-0730b36d29ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be6b641-610f-465b-98d8-0730b36d29ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1575348492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d90c36d057e43219fd3d3ef63a24dd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:55Z,use_quota=True,user_id='ef6171cda5ff4e01ae0a598d7398524a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a2b170-d3a0-4546-9f86-e3bb8cbd90ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a2b170-d3a0-4546-9f86-e3bb8cbd90ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6c8f8c-7b98-44f7-a3a9-6758be07bec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6c8f8c-7b98-44f7-a3a9-6758be07bec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0', 'volume_name': 'volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101856ce-7ac1-4496-a2dc-d80e86059f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101856ce-7ac1-4496-a2dc-d80e86059f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3afdc5-b1e8-4ebf-b675-62c6247c9b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:55 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Volume 7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0', 'volume_size': 1} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1575348492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d90c36d057e43219fd3d3ef63a24dd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:38:55Z,use_quota=True,user_id='ef6171cda5ff4e01ae0a598d7398524a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Creating volume 7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:38:55 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "cinder-be0d96cd-1fd4-419b-8523-9480d007a30a-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:55 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 1073741824 Sep 30 10:38:55 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-be0d96cd-1fd4-419b-8523-9480d007a30a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "cinder-quobyte-be0d96cd-1fd4-419b-8523-9480d007a30a" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-quobyte-be0d96cd-1fd4-419b-8523-9480d007a30a" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb0bd7e-265e-4dbe-8681-86b02cdcd1aa]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:55 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a Sep 30 10:38:55 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:56 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 1073741824" returned: 0 in 0.541s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:56 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a" returned: 0 in 0.476s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:56 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 Sep 30 10:38:56 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:56 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a Sep 30 10:38:56 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:56 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0" returned: 0 in 0.278s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3afdc5-b1e8-4ebf-b675-62c6247c9b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d024db6-407b-4680-9571-f551c902ac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:38:56 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-be0d96cd-1fd4-419b-8523-9480d007a30a" returned: 0 in 0.304s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:56 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Volume volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 (7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0): created successfully Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d024db6-407b-4680-9571-f551c902ac01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Flow 'volume_create_manager' (70511b27-ae7d-41ba-bb92-3a86e1f81fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-quobyte-be0d96cd-1fd4-419b-8523-9480d007a30a" released by "delete_volume" :: held 0.861s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d8e2fb96-59ea-43dd-876e-82aa92794b90 tempest-VolumesTransfersV357Test-1177374056 None] Created volume successfully. Sep 30 10:38:56 devstack cinder-volume[87013]: WARNING cinder.quota [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-686863410-644427964 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-686863410-644427964, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:38:56 devstack cinder-volume[87013]: WARNING cinder.quota [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-686863410-644427964 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-686863410-644427964, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Created reservations ['089e2b5a-1df1-4006-8baa-01bd8d21fff8', 'f1a1f350-475c-4702-b61b-3336d199e207', '531f8e75-76e1-4ac4-af12-beba260ccf40', '8c84f43b-487e-476a-8c02-d9bb342384d3'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:56 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:38:56 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "cinder-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "cinder-quobyte-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-quobyte-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc18ee26-e922-437c-bac1-c789d436add1]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:56 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:56 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 Sep 30 10:38:56 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.323s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:38:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Deleted volume successfully. Sep 30 10:38:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fda67d15-13a0-48d5-91e1-3c8099fb7a3f tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-be0d96cd-1fd4-419b-8523-9480d007a30a-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:57 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3" returned: 0 in 0.403s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:57 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3 Sep 30 10:38:57 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:57 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3" returned: 0 in 0.252s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-quobyte-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3" released by "delete_volume" :: held 0.724s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:57 devstack cinder-volume[87013]: WARNING cinder.quota [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156703660-292102274 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156703660-292102274, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:38:57 devstack cinder-volume[87013]: WARNING cinder.quota [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156703660-292102274 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156703660-292102274, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Created reservations ['e8ca2f23-5e05-46fe-8471-a9257294ab4f', '1dbf1106-5891-4389-92cb-d109d729cead', '120c53ed-8f10-4d65-91a6-3839533bb74f', '68e86094-b9d1-437e-a6ce-a11eb6bd5773'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:57 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:38:57 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Acquiring lock "cinder-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Lock "cinder-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "cinder-ac25fea5-b54a-43b6-9b05-2bd485f4f902-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:57 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Acquiring lock "cinder-quobyte-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Deleted volume successfully. Sep 30 10:38:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-ac25fea5-b54a-43b6-9b05-2bd485f4f902-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Lock "cinder-quobyte-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0" acquired by "delete_volume" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7de1e330-3328-4d10-b33d-abed971ff097 tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-d4e8d857-d5a0-4ca2-b2e6-9557a76832d3-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d79981-35c0-4093-bbb9-e2f8007ba717]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "cinder-quobyte-ac25fea5-b54a-43b6-9b05-2bd485f4f902" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-quobyte-ac25fea5-b54a-43b6-9b05-2bd485f4f902" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a1d403-4b5d-4968-a5c8-4f0bf134530d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:58 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 Sep 30 10:38:58 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:58 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902 Sep 30 10:38:58 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:58 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0" returned: 0 in 0.400s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:58 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0 Sep 30 10:38:58 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:58 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902" returned: 0 in 0.432s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:58 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902 Sep 30 10:38:58 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:58 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0" returned: 0 in 0.295s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Lock "cinder-quobyte-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0" released by "delete_volume" :: held 0.759s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:58 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ac25fea5-b54a-43b6-9b05-2bd485f4f902" returned: 0 in 0.303s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Created reservations ['1b74059e-ec36-4079-af35-7fe74938b41f', '42c41da1-63ec-496e-b5d4-21a04e288434', '89ebe13c-918e-4f72-b553-2343a39dd581', 'cb0b02bc-50e1-426d-988e-87117239e24f'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-quobyte-ac25fea5-b54a-43b6-9b05-2bd485f4f902" released by "delete_volume" :: held 0.813s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:58 devstack cinder-volume[87013]: WARNING cinder.quota [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1722084646-73069439 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1722084646-73069439, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:38:58 devstack cinder-volume[87013]: WARNING cinder.quota [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1722084646-73069439 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1722084646-73069439, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Created reservations ['5cab21d1-dfe3-4855-8e75-ee33e5052a7b', 'd0e9d4a2-445c-49a4-a191-cd7979ee0bd1', '8259ed2a-7919-41bf-8db0-f9e316dcd133', '23cf96db-2387-4737-b1d1-4254105ff969'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:38:59 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:38:59 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:38:59 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:38:59 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:38:59 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.404s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:38:59 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Deleted volume successfully. Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-19eed85b-8cdb-4311-9a16-c4c149711ac7 tempest-VolumesTransfersV357Test-891631247 None] Lock "cinder-7c8eaaf8-348d-440d-ace1-9bf9f1bbfed0-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:38:59 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.436s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:38:59 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Deleted volume successfully. Sep 30 10:38:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-71eff214-8c7d-458c-b39b-6db7ba9ad58b tempest-TestInstancesWithCinderVolumes-1168861503 None] Lock "cinder-ac25fea5-b54a-43b6-9b05-2bd485f4f902-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=70,cinder:UPDATE=85,cinder:DELETE=9,cinder:INSERT=22 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=67,cinder:UPDATE=91,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Flow 'volume_create_manager' (8bf42e3f-e2e2-4e25-89db-321b2b9803c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e4b1eb-a42c-407c-ae65-f9a7e8d7727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e4b1eb-a42c-407c-ae65-f9a7e8d7727d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-924659543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d516ccd-74e5-45a5-af79-3ab563e7eca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e608c348ea746db9226f408cdc1c993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:09Z,use_quota=True,user_id='cc5176c7ffa4495687a8a92af2f6448b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dae2088-33ca-490a-9323-4e09a819c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dae2088-33ca-490a-9323-4e09a819c898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a0d656-415c-494e-8c03-ea2dec422d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG cinder.image.glance [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Creating Keystone auth plugin from conf {{(pid=87013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 10:39:09 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Flow 'volume_create_manager' (7c36470c-5e00-415d-affe-408eb2a85224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fd8e99-f121-4eca-98be-2aadb5b77ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fd8e99-f121-4eca-98be-2aadb5b77ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554500094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150855c1-475f-4c58-bcdc-8ab990e690da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ede450571a74671b1482295723d0e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:10Z,use_quota=True,user_id='00fec5ebaaae4d0fa67d1482d99bf2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abb5db1-0410-4466-974c-f004678acc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abb5db1-0410-4466-974c-f004678acc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92dec98-1029-47d9-b21d-c7a3df1f48f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92dec98-1029-47d9-b21d-c7a3df1f48f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '150855c1-475f-4c58-bcdc-8ab990e690da', 'volume_name': 'volume-150855c1-475f-4c58-bcdc-8ab990e690da', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9efb20-1f57-4e51-abb3-f5791da58fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9efb20-1f57-4e51-abb3-f5791da58fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834576fb-00be-42c3-8cab-abfae252f8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Volume 150855c1-475f-4c58-bcdc-8ab990e690da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-150855c1-475f-4c58-bcdc-8ab990e690da', 'volume_size': 1} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554500094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150855c1-475f-4c58-bcdc-8ab990e690da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ede450571a74671b1482295723d0e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:10Z,use_quota=True,user_id='00fec5ebaaae4d0fa67d1482d99bf2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Creating volume 150855c1-475f-4c58-bcdc-8ab990e690da {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:10 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:10 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da 1073741824 Sep 30 10:39:10 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Flow 'volume_create_manager' (8c01b405-6c45-420b-b971-2e7b8a3538d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84d1d31-fb4e-496f-96fe-789d7b74ebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84d1d31-fb4e-496f-96fe-789d7b74ebb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1929670759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebd720d-eaf9-4814-a54c-e54f12e86523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ede450571a74671b1482295723d0e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:10Z,use_quota=True,user_id='00fec5ebaaae4d0fa67d1482d99bf2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c049b6b6-60d8-4327-9737-a5feaacb54ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c049b6b6-60d8-4327-9737-a5feaacb54ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87bd773-7fe2-4eaa-8f10-174b8d95c6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87bd773-7fe2-4eaa-8f10-174b8d95c6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebd720d-eaf9-4814-a54c-e54f12e86523', 'volume_name': 'volume-2ebd720d-eaf9-4814-a54c-e54f12e86523', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77924bba-f10b-4dce-98d4-3d11dc8f3c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77924bba-f10b-4dce-98d4-3d11dc8f3c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a964e1cb-50bd-498e-84c7-2720201f2e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Volume 2ebd720d-eaf9-4814-a54c-e54f12e86523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebd720d-eaf9-4814-a54c-e54f12e86523', 'volume_size': 1} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a0d656-415c-494e-8c03-ea2dec422d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d516ccd-74e5-45a5-af79-3ab563e7eca0', 'volume_name': 'volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b00f204-cafb-4f3b-99ba-3bdc8c1496f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b00f204-cafb-4f3b-99ba-3bdc8c1496f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65640687-6b4e-415e-b850-c963a92edd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Volume 9d516ccd-74e5-45a5-af79-3ab563e7eca0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Trying to clone 9d516ccd-74e5-45a5-af79-3ab563e7eca0 from image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]). {{(pid=87013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Flow 'volume_create_manager' (35117b2e-be7f-4fad-8008-62b43916f52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8aae2c8-f1fa-4fe9-a9a2-31bce3be507c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8aae2c8-f1fa-4fe9-a9a2-31bce3be507c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683737926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6f0083-0bb9-4155-8896-52337ec505ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ede450571a74671b1482295723d0e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:10Z,use_quota=True,user_id='00fec5ebaaae4d0fa67d1482d99bf2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0a4069-e06d-4812-9400-559df56a1d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0a4069-e06d-4812-9400-559df56a1d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44eee39-3f3d-451a-9ed4-88cf78dec1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44eee39-3f3d-451a-9ed4-88cf78dec1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6f0083-0bb9-4155-8896-52337ec505ee', 'volume_name': 'volume-6e6f0083-0bb9-4155-8896-52337ec505ee', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2110c73-4b48-4d9b-a1b8-a6f3cd49590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2110c73-4b48-4d9b-a1b8-a6f3cd49590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081514c9-4446-495f-a017-12e0be76cc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:10 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Volume 6e6f0083-0bb9-4155-8896-52337ec505ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6f0083-0bb9-4155-8896-52337ec505ee', 'volume_size': 1} Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:10 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da 1073741824" returned: 0 in 0.802s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Flow 'volume_create_manager' (6085c733-1454-4e3a-82f1-03fdfa692779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d53ad97-587e-4d13-9d6b-fefc964b18bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d53ad97-587e-4d13-9d6b-fefc964b18bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431341780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b01cf16-159a-4d48-94f1-c95f0f273e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ede450571a74671b1482295723d0e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:11Z,use_quota=True,user_id='00fec5ebaaae4d0fa67d1482d99bf2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4200ff88-916d-42d1-9726-e73a7e8d9daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4200ff88-916d-42d1-9726-e73a7e8d9daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4618cce2-0789-4026-a720-03f1c84dd51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4618cce2-0789-4026-a720-03f1c84dd51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b01cf16-159a-4d48-94f1-c95f0f273e01', 'volume_name': 'volume-0b01cf16-159a-4d48-94f1-c95f0f273e01', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17db496-7a60-44a0-9a4a-07362e977f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17db496-7a60-44a0-9a4a-07362e977f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5668c6e5-f486-4ce3-a6a7-4646c4335e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Volume 0b01cf16-159a-4d48-94f1-c95f0f273e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b01cf16-159a-4d48-94f1-c95f0f273e01', 'volume_size': 1} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:11 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da Sep 30 10:39:11 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 10:39:11 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Image download 20.69 MB at 20.69 MB/s Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b594250-6bdd-4740-ac09-d2c655733427]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:11 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD Sep 30 10:39:11 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Flow 'volume_create_manager' (bdfac74c-cee7-44a7-b1dd-886b574dd88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638ad5ee-34c9-48f8-bd89-a37f5d41cb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638ad5ee-34c9-48f8-bd89-a37f5d41cb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1547883281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce36ef1-cbda-447d-9ea7-8632b22d4cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ede450571a74671b1482295723d0e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:11Z,use_quota=True,user_id='00fec5ebaaae4d0fa67d1482d99bf2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f81ead-85ae-4398-958e-1973312aaac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f81ead-85ae-4398-958e-1973312aaac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d28a87-ecc6-498b-b175-e24b9c7bb179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d28a87-ecc6-498b-b175-e24b9c7bb179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce36ef1-cbda-447d-9ea7-8632b22d4cf0', 'volume_name': 'volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:11 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ba6834-f7c5-4d98-a437-3a4fc7441345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ba6834-f7c5-4d98-a437-3a4fc7441345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be90319-22fd-4ec9-8c60-8100ce95e2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Volume 3ce36ef1-cbda-447d-9ea7-8632b22d4cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0', 'volume_size': 1} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da" returned: 0 in 0.458s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.214s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1929670759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebd720d-eaf9-4814-a54c-e54f12e86523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ede450571a74671b1482295723d0e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:10Z,use_quota=True,user_id='00fec5ebaaae4d0fa67d1482d99bf2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Creating volume 2ebd720d-eaf9-4814-a54c-e54f12e86523 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:11 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:11 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523 1073741824 Sep 30 10:39:11 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834576fb-00be-42c3-8cab-abfae252f8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-150855c1-475f-4c58-bcdc-8ab990e690da', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e906f0e4-a091-4bbc-9f6e-9d395fb91838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:11 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Volume volume-150855c1-475f-4c58-bcdc-8ab990e690da (150855c1-475f-4c58-bcdc-8ab990e690da): created successfully Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e906f0e4-a091-4bbc-9f6e-9d395fb91838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Flow 'volume_create_manager' (7c36470c-5e00-415d-affe-408eb2a85224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:11 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7f3b6cbe-2ba5-45f2-8cc5-1564259ff870 tempest-CreateVolumesFromImageTest-1317004011 None] Created volume successfully. Sep 30 10:39:11 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Temporary image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e is fetched for user cc5176c7ffa4495687a8a92af2f6448b. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b27580b-b00b-4a4b-813d-09e03302824d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:12 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD Sep 30 10:39:12 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:12 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523 1073741824" returned: 0 in 0.535s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:12 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:12 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523 Sep 30 10:39:12 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:12 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523" returned: 0 in 0.291s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683737926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6f0083-0bb9-4155-8896-52337ec505ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ede450571a74671b1482295723d0e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:10Z,use_quota=True,user_id='00fec5ebaaae4d0fa67d1482d99bf2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Creating volume 6e6f0083-0bb9-4155-8896-52337ec505ee {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:12 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:12 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee 1073741824 Sep 30 10:39:12 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a964e1cb-50bd-498e-84c7-2720201f2e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebd720d-eaf9-4814-a54c-e54f12e86523', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf32d89-e478-4a19-b054-f24babea0a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:12 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Volume volume-2ebd720d-eaf9-4814-a54c-e54f12e86523 (2ebd720d-eaf9-4814-a54c-e54f12e86523): created successfully Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf32d89-e478-4a19-b054-f24babea0a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Flow 'volume_create_manager' (8c01b405-6c45-420b-b971-2e7b8a3538d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ea60a58d-4ef9-4db7-8e1e-f6796584dee0 tempest-CreateVolumesFromImageTest-1317004011 None] Created volume successfully. Sep 30 10:39:13 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee 1073741824" returned: 0 in 0.484s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:13 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee Sep 30 10:39:13 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:13 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee" returned: 0 in 0.257s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.166s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431341780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b01cf16-159a-4d48-94f1-c95f0f273e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ede450571a74671b1482295723d0e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:11Z,use_quota=True,user_id='00fec5ebaaae4d0fa67d1482d99bf2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Creating volume 0b01cf16-159a-4d48-94f1-c95f0f273e01 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:13 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081514c9-4446-495f-a017-12e0be76cc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6f0083-0bb9-4155-8896-52337ec505ee', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac8a4ad-6850-422a-b5e3-72cd78449e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:13 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01 1073741824 Sep 30 10:39:13 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:13 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Volume volume-6e6f0083-0bb9-4155-8896-52337ec505ee (6e6f0083-0bb9-4155-8896-52337ec505ee): created successfully Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac8a4ad-6850-422a-b5e3-72cd78449e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Flow 'volume_create_manager' (35117b2e-be7f-4fad-8008-62b43916f52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:13 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-54444d36-cc11-42c1-bc44-7d44ec6e29f1 tempest-CreateVolumesFromImageTest-1317004011 None] Created volume successfully. Sep 30 10:39:13 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01 1073741824" returned: 0 in 0.487s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:13 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01 Sep 30 10:39:13 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:14 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01" returned: 0 in 0.253s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.485s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1547883281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce36ef1-cbda-447d-9ea7-8632b22d4cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ede450571a74671b1482295723d0e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:11Z,use_quota=True,user_id='00fec5ebaaae4d0fa67d1482d99bf2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Creating volume 3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:14 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5668c6e5-f486-4ce3-a6a7-4646c4335e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b01cf16-159a-4d48-94f1-c95f0f273e01', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:14 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 1073741824 Sep 30 10:39:14 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9eed639-a40d-4994-8753-706342d127fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:14 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Volume volume-0b01cf16-159a-4d48-94f1-c95f0f273e01 (0b01cf16-159a-4d48-94f1-c95f0f273e01): created successfully Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9eed639-a40d-4994-8753-706342d127fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Flow 'volume_create_manager' (6085c733-1454-4e3a-82f1-03fdfa692779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:14 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-07411c8f-0404-4ee0-8c63-846f065aabee tempest-CreateVolumesFromImageTest-1317004011 None] Created volume successfully. Sep 30 10:39:14 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 1073741824" returned: 0 in 0.507s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:14 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 Sep 30 10:39:14 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:14 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0" returned: 0 in 0.268s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.678s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-924659543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d516ccd-74e5-45a5-af79-3ab563e7eca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e608c348ea746db9226f408cdc1c993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:09Z,use_quota=True,user_id='cc5176c7ffa4495687a8a92af2f6448b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Creating volume 9d516ccd-74e5-45a5-af79-3ab563e7eca0 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:14 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be90319-22fd-4ec9-8c60-8100ce95e2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1aea63-1e1b-4308-8282-710dd1bc4190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:14 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 1073741824 Sep 30 10:39:14 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:14 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Volume volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 (3ce36ef1-cbda-447d-9ea7-8632b22d4cf0): created successfully Sep 30 10:39:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1aea63-1e1b-4308-8282-710dd1bc4190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Flow 'volume_create_manager' (bdfac74c-cee7-44a7-b1dd-886b574dd88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:15 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d038171d-74e6-4445-b915-0fd1a58bd404 tempest-CreateVolumesFromImageTest-1317004011 None] Created volume successfully. Sep 30 10:39:15 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 1073741824" returned: 0 in 0.472s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:15 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 Sep 30 10:39:15 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:15 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0" returned: 0 in 0.276s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:15 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Attempting download of 0e96b9f2-4ae9-48ec-8d88-8e11a591034e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}])) to volume 9d516ccd-74e5-45a5-af79-3ab563e7eca0. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 10:39:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e683b14e-1ca4-4216-8724-a4ff1d9878a1]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_vqgsd1z_ {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:15 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_vqgsd1z_ Sep 30 10:39:15 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "cinder-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "cinder-quobyte-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-quobyte-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acc7ca8-0b63-4ce7-9ee5-b1581f1e8148]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:16 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_vqgsd1z_" returned: 0 in 0.391s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_vqgsd1z_ {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:16 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 Sep 30 10:39:16 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:16 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_vqgsd1z_ Sep 30 10:39:16 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:16 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0" returned: 0 in 0.395s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:16 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0 Sep 30 10:39:16 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:16 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_vqgsd1z_" returned: 1 in 0.368s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_vqgsd1z_' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee0803-78e2-480c-8d6b-fe25b56ad310]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:16 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD Sep 30 10:39:16 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:16 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0" returned: 0 in 0.278s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-quobyte-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0" released by "delete_volume" :: held 0.742s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Created reservations ['b9a07787-7fa1-4b5c-ae06-755bdea65931', '2f2b1dae-b3b6-4559-9a17-0a25f27163e0', 'cf2c5cd8-c0dd-401a-8edb-20616c7e0e36', '11602bff-43f6-4934-8152-30669e31d723'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:16 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:16 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:17 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] 0e96b9f2-4ae9-48ec-8d88-8e11a591034e was qcow2, converting to qcow2 {{(pid=87013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:17 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 Sep 30 10:39:17 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "cinder-0b01cf16-159a-4d48-94f1-c95f0f273e01-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-0b01cf16-159a-4d48-94f1-c95f0f273e01-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:17 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.294s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:17 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Deleted volume successfully. Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "cinder-quobyte-0b01cf16-159a-4d48-94f1-c95f0f273e01" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-20e17b4e-8fa8-4e24-893a-9d21bf7fbfb4 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-3ce36ef1-cbda-447d-9ea7-8632b22d4cf0-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-quobyte-0b01cf16-159a-4d48-94f1-c95f0f273e01" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01616a7-59c9-47ef-96b1-a675175624bb]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:17 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01 Sep 30 10:39:17 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:17 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01" returned: 0 in 0.435s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:17 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01 Sep 30 10:39:17 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:18 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0b01cf16-159a-4d48-94f1-c95f0f273e01" returned: 0 in 0.439s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-quobyte-0b01cf16-159a-4d48-94f1-c95f0f273e01" released by "delete_volume" :: held 0.919s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Created reservations ['7c9d6381-62c2-4667-bc8c-5054bae1fc94', 'e0a2d7dd-855f-43fc-9aeb-5c05891aec74', '44953ceb-46ff-4412-b321-ebaefef0bdf7', 'f13a7cd7-cdae-4885-8b65-e0bb5af64d8e'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:18 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:18 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:18 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.281s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:18 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Deleted volume successfully. Sep 30 10:39:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d5b9fc8b-2bb7-45b1-a833-58d20088dbf5 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-0b01cf16-159a-4d48-94f1-c95f0f273e01-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:19 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0" returned: 0 in 2.272s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_q3ymwtjzdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:39:19 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Converted 112.00 MB image at 49.28 MB/s Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:19 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 1G Sep 30 10:39:19 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "cinder-6e6f0083-0bb9-4155-8896-52337ec505ee-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-6e6f0083-0bb9-4155-8896-52337ec505ee-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "cinder-quobyte-6e6f0083-0bb9-4155-8896-52337ec505ee" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-quobyte-6e6f0083-0bb9-4155-8896-52337ec505ee" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9350942-40e5-45d4-86e0-01e1374ff093]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:19 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 1G" returned: 0 in 0.540s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Downloaded image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}])) to volume 9d516ccd-74e5-45a5-af79-3ab563e7eca0 successfully. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 10:39:19 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee Sep 30 10:39:19 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Temporary image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e for user cc5176c7ffa4495687a8a92af2f6448b is deleted. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Marking volume 9d516ccd-74e5-45a5-af79-3ab563e7eca0 as bootable. {{(pid=87013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Copying metadata from image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e to 9d516ccd-74e5-45a5-af79-3ab563e7eca0. {{(pid=87013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 10:39:19 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Creating volume glance metadata for volume 9d516ccd-74e5-45a5-af79-3ab563e7eca0 backed by image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65640687-6b4e-415e-b850-c963a92edd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad9e2d4-983e-493b-9b25-d0cb39ea95a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:20 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Volume volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 (9d516ccd-74e5-45a5-af79-3ab563e7eca0): created successfully Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad9e2d4-983e-493b-9b25-d0cb39ea95a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Flow 'volume_create_manager' (8bf42e3f-e2e2-4e25-89db-321b2b9803c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-809821b4-0820-42fa-80f6-e3567e224bd2 tempest-VolumesExtendTest-286914916 None] Created volume successfully. Sep 30 10:39:20 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee" returned: 0 in 0.486s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:20 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee Sep 30 10:39:20 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:20 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-6e6f0083-0bb9-4155-8896-52337ec505ee" returned: 0 in 0.260s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-quobyte-6e6f0083-0bb9-4155-8896-52337ec505ee" released by "delete_volume" :: held 0.793s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Created reservations ['63583ea0-da7d-4832-9191-b880bbbaefac', '0af91b8a-b342-4f98-b8d6-24aa2b75a92e', 'de468550-9a98-4513-ab12-762cfa958815', '758ab371-b6bd-474f-b8e6-75a137c6facf'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:20 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:20 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "cinder-2ebd720d-eaf9-4814-a54c-e54f12e86523-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-2ebd720d-eaf9-4814-a54c-e54f12e86523-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "cinder-quobyte-2ebd720d-eaf9-4814-a54c-e54f12e86523" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:20 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.280s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-quobyte-2ebd720d-eaf9-4814-a54c-e54f12e86523" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Deleted volume successfully. Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6c1160-2e27-4330-b79e-deae71a9f51f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fca6d8b0-39dd-46fe-b425-7d41af51e265 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-6e6f0083-0bb9-4155-8896-52337ec505ee-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:21 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523 Sep 30 10:39:21 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8615ff51-66ad-4155-9e7e-b081a06c6d1a tempest-VolumesExtendTest-286914916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8615ff51-66ad-4155-9e7e-b081a06c6d1a tempest-VolumesExtendTest-286914916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ef73bd-b016-4b3a-844d-2bc907ffa524]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8615ff51-66ad-4155-9e7e-b081a06c6d1a tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:21 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523" returned: 0 in 0.457s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:21 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523 Sep 30 10:39:21 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:21 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 Sep 30 10:39:21 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:21 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2ebd720d-eaf9-4814-a54c-e54f12e86523" returned: 0 in 0.288s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-quobyte-2ebd720d-eaf9-4814-a54c-e54f12e86523" released by "delete_volume" :: held 0.807s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Created reservations ['6c8250db-e500-4469-b0b4-082d6dd8d16c', '8ae380f1-455a-4f0a-b5b8-efe2a2d22b44', '4e9d184f-f331-44e3-ab53-1276e63a3cdf', 'fc51fa6d-b43c-45bd-92cd-61e509839c79'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:21 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8615ff51-66ad-4155-9e7e-b081a06c6d1a tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0" returned: 0 in 0.469s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8615ff51-66ad-4155-9e7e-b081a06c6d1a tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 2G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:21 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:21 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8615ff51-66ad-4155-9e7e-b081a06c6d1a tempest-VolumesExtendTest-286914916 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 2G" returned: 0 in 0.152s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8615ff51-66ad-4155-9e7e-b081a06c6d1a tempest-VolumesExtendTest-286914916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.650s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:22 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8615ff51-66ad-4155-9e7e-b081a06c6d1a tempest-VolumesExtendTest-286914916 None] Extend volume completed successfully. Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "cinder-150855c1-475f-4c58-bcdc-8ab990e690da-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-150855c1-475f-4c58-bcdc-8ab990e690da-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "cinder-quobyte-150855c1-475f-4c58-bcdc-8ab990e690da" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-quobyte-150855c1-475f-4c58-bcdc-8ab990e690da" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff161384-4f46-42dd-acc9-39be409057b2]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:22 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.325s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:22 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Deleted volume successfully. Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-30dc1881-1497-460f-842f-f100763a5c90 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-2ebd720d-eaf9-4814-a54c-e54f12e86523-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:22 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da Sep 30 10:39:22 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:22 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da" returned: 0 in 0.454s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:22 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da Sep 30 10:39:22 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Acquiring lock "cinder-9d516ccd-74e5-45a5-af79-3ab563e7eca0-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Lock "cinder-9d516ccd-74e5-45a5-af79-3ab563e7eca0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:22 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-150855c1-475f-4c58-bcdc-8ab990e690da" returned: 0 in 0.325s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Acquiring lock "cinder-quobyte-9d516ccd-74e5-45a5-af79-3ab563e7eca0" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-quobyte-150855c1-475f-4c58-bcdc-8ab990e690da" released by "delete_volume" :: held 0.852s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Lock "cinder-quobyte-9d516ccd-74e5-45a5-af79-3ab563e7eca0" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[70de1632-b15b-46c4-9e9e-fb71ed03d928]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Created reservations ['4e80ba20-d2c7-4410-a6cc-d0410a24e7a3', '25f9c73c-c02b-45c4-a32f-b29d49244a29', 'b819df8b-62ca-4182-abe2-04920ad02ab1', 'ff976bfa-b044-4898-a55c-3a321993c8cb'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:23 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 Sep 30 10:39:23 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:23 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:23 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:23 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.302s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:23 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Deleted volume successfully. Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fb72975b-8a23-47ca-9f13-fc253173d072 tempest-CreateVolumesFromImageTest-1317004011 None] Lock "cinder-150855c1-475f-4c58-bcdc-8ab990e690da-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:23 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0" returned: 0 in 0.504s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:23 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0 Sep 30 10:39:23 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:23 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9d516ccd-74e5-45a5-af79-3ab563e7eca0" returned: 0 in 0.301s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Lock "cinder-quobyte-9d516ccd-74e5-45a5-af79-3ab563e7eca0" released by "delete_volume" :: held 0.859s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:23 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Created reservations ['ea8ff44f-b0cf-45dd-8ce2-e01fbf080b63', '4664e402-4b2b-4f50-96ff-d1ae317fcd8d', '39fe769b-054a-44e4-a9c4-17c5c9e1d9d9', '73bb1f28-676c-4894-b15b-9b8d802e6c8b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:24 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:24 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:24 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.385s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:24 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Deleted volume successfully. Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70a7365b-4887-4a7a-933b-8c88df3f1951 tempest-VolumesExtendTest-286914916 None] Lock "cinder-9d516ccd-74e5-45a5-af79-3ab563e7eca0-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Flow 'volume_create_manager' (5f8e59c8-d3ee-4f0f-b8c5-a40b00bc4d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40971589-e203-47e4-a1e2-1f31739d57bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40971589-e203-47e4-a1e2-1f31739d57bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-152584483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e748ba-6a01-450e-ac37-a03ca59611a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e608c348ea746db9226f408cdc1c993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:25Z,use_quota=True,user_id='cc5176c7ffa4495687a8a92af2f6448b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637a2b88-d6cc-464a-b0c7-15a482bbaeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637a2b88-d6cc-464a-b0c7-15a482bbaeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44b4890-11a3-49e2-be1c-f958f464789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44b4890-11a3-49e2-be1c-f958f464789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e748ba-6a01-450e-ac37-a03ca59611a1', 'volume_name': 'volume-33e748ba-6a01-450e-ac37-a03ca59611a1', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386008e1-95ae-4508-9a32-2353e0136bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386008e1-95ae-4508-9a32-2353e0136bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625dbc99-8130-4a66-a562-58e337e878a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:24 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Volume 33e748ba-6a01-450e-ac37-a03ca59611a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e748ba-6a01-450e-ac37-a03ca59611a1', 'volume_size': 1} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-152584483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e748ba-6a01-450e-ac37-a03ca59611a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e608c348ea746db9226f408cdc1c993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:25Z,use_quota=True,user_id='cc5176c7ffa4495687a8a92af2f6448b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Creating volume 33e748ba-6a01-450e-ac37-a03ca59611a1 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:24 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:24 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 1073741824 Sep 30 10:39:24 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:25 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 1073741824" returned: 0 in 0.559s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:25 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 Sep 30 10:39:25 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:25 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1" returned: 0 in 0.283s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625dbc99-8130-4a66-a562-58e337e878a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e748ba-6a01-450e-ac37-a03ca59611a1', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0993df-37df-4b88-8551-5cac6112b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:25 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Volume volume-33e748ba-6a01-450e-ac37-a03ca59611a1 (33e748ba-6a01-450e-ac37-a03ca59611a1): created successfully Sep 30 10:39:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0993df-37df-4b88-8551-5cac6112b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Flow 'volume_create_manager' (5f8e59c8-d3ee-4f0f-b8c5-a40b00bc4d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:25 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f5a86080-44da-4a79-9d68-447fdf19a908 tempest-VolumesExtendTest-286914916 None] Created volume successfully. Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (fc85e053-e0bc-40df-8e6c-934761e3ba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a36e95-2b07-4659-b6e8-feb30e7116bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a36e95-2b07-4659-b6e8-feb30e7116bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644633769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbad481f-6016-423d-8b1e-2d8385c49000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:27Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a43eb26-77a7-4124-a07f-29139c9c52cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a43eb26-77a7-4124-a07f-29139c9c52cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb161438-2ad7-4cdd-a514-42c1559de897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb161438-2ad7-4cdd-a514-42c1559de897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbad481f-6016-423d-8b1e-2d8385c49000', 'volume_name': 'volume-dbad481f-6016-423d-8b1e-2d8385c49000', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d9e65c-ec1f-4210-b63a-c59d580c1fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d9e65c-ec1f-4210-b63a-c59d580c1fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084cd627-3b81-42a1-af8e-a96dfd347ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:26 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume dbad481f-6016-423d-8b1e-2d8385c49000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbad481f-6016-423d-8b1e-2d8385c49000', 'volume_size': 1} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644633769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbad481f-6016-423d-8b1e-2d8385c49000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:27Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Creating volume dbad481f-6016-423d-8b1e-2d8385c49000 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:26 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:26 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000 1073741824 Sep 30 10:39:26 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:27 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000 1073741824" returned: 0 in 0.529s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:27 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000 Sep 30 10:39:27 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:27 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000" returned: 0 in 0.293s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.590s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084cd627-3b81-42a1-af8e-a96dfd347ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbad481f-6016-423d-8b1e-2d8385c49000', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58988f19-7ae3-4d7f-a64f-341324a3903e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Creating offline snapshot 8f8191a3-2e88-472c-b1ac-28ff638e0d9a of volume 33e748ba-6a01-450e-ac37-a03ca59611a1 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:39:27 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume volume-dbad481f-6016-423d-8b1e-2d8385c49000 (dbad481f-6016-423d-8b1e-2d8385c49000): created successfully Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58988f19-7ae3-4d7f-a64f-341324a3903e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (fc85e053-e0bc-40df-8e6c-934761e3ba0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ecc7a7-7f84-4484-b36b-c85a524e8435]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:27 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-4d883d02-1eb4-43cd-b763-09df443aab02 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created volume successfully. Sep 30 10:39:27 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 Sep 30 10:39:27 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:28 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1" returned: 0 in 0.392s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:28 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a 1G Sep 30 10:39:28 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:28 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a 1G" returned: 0 in 0.447s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e748ba-6a01-450e-ac37-a03ca59611a1 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:28 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e748ba-6a01-450e-ac37-a03ca59611a1 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a Sep 30 10:39:28 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:28 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e748ba-6a01-450e-ac37-a03ca59611a1 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a" returned: 0 in 0.372s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:28 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a is being set with open permissions: ugo+rw Sep 30 10:39:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:28 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a Sep 30 10:39:28 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:29 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a" returned: 0 in 0.282s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:29 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.info Sep 30 10:39:29 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (7b761649-9f59-486b-9b44-7af4a3e54c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf4a695-a2c0-4b98-8397-32af2eb82f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf4a695-a2c0-4b98-8397-32af2eb82f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-21523245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6e7fd7-d255-4aa1-856d-521ef24deac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:29Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdf0c27-6779-4d31-a9f8-68172891902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdf0c27-6779-4d31-a9f8-68172891902b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169490d8-d189-4ec5-bef9-e5fb2ffee15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169490d8-d189-4ec5-bef9-e5fb2ffee15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6e7fd7-d255-4aa1-856d-521ef24deac7', 'volume_name': 'volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3acc7f-6677-4cbc-8063-f3b95637e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3acc7f-6677-4cbc-8063-f3b95637e835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f04896a-16e7-4dbc-b75b-6cf65b7f1660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:29 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume dc6e7fd7-d255-4aa1-856d-521ef24deac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7', 'volume_size': 1} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:29 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.info" returned: 0 in 0.403s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:29 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.info is being set with open permissions: ugo+rw Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:29 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.info Sep 30 10:39:29 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (23042d3c-d651-4ed9-ab78-a8e451889001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886334b6-ac96-4ffc-82f8-dd5b2dbf3e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886334b6-ac96-4ffc-82f8-dd5b2dbf3e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1135755850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497d98e6-b3b9-447c-916f-1305705bbaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:30Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5675eadd-6b8e-460d-a630-5a226b2b6d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5675eadd-6b8e-460d-a630-5a226b2b6d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78831ee2-c391-4d72-9a88-32f9bb6bfa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78831ee2-c391-4d72-9a88-32f9bb6bfa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497d98e6-b3b9-447c-916f-1305705bbaca', 'volume_name': 'volume-497d98e6-b3b9-447c-916f-1305705bbaca', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d101a5-c205-47c7-bb75-83cf44d24e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d101a5-c205-47c7-bb75-83cf44d24e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e659e1-8bbb-4259-b912-775b4d9a6adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:29 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume 497d98e6-b3b9-447c-916f-1305705bbaca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497d98e6-b3b9-447c-916f-1305705bbaca', 'volume_size': 1} Sep 30 10:39:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:30 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.info" returned: 0 in 0.365s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-21523245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6e7fd7-d255-4aa1-856d-521ef24deac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:29Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Creating volume dc6e7fd7-d255-4aa1-856d-521ef24deac7 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:30 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:30 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7 1073741824 Sep 30 10:39:30 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c3cf3a89-da49-497c-923f-9d26b34c08b9 tempest-VolumesExtendTest-286914916 None] Create snapshot completed successfully Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (f0874ca0-a2c6-4fe2-a74f-7813d0ecc25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1f38c7-5462-40b6-862a-cfeb0ba8a2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1f38c7-5462-40b6-862a-cfeb0ba8a2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1617043268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7464f4-f41e-42d7-b722-be4d8b36e8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:30Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27519561-b35f-40b5-b729-7f08f37f6d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27519561-b35f-40b5-b729-7f08f37f6d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee4ce4a-506b-4c16-a99b-34d229227ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee4ce4a-506b-4c16-a99b-34d229227ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7464f4-f41e-42d7-b722-be4d8b36e8b4', 'volume_name': 'volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8533442c-42ea-4b23-af93-f45d593158a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8533442c-42ea-4b23-af93-f45d593158a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4632aefe-c236-46fe-b07d-00f8c478c798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume 7e7464f4-f41e-42d7-b722-be4d8b36e8b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4', 'volume_size': 1} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (7d8d254b-7b59-420e-b427-d4a332b85a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fee4974-0bae-421a-b1c1-b8cf046a5ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fee4974-0bae-421a-b1c1-b8cf046a5ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1897765582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ea5fd1-ceb8-424f-8367-d57c66ca09f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:30Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279dfa5d-e95e-41f9-acae-ca89c9286290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279dfa5d-e95e-41f9-acae-ca89c9286290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e09365d-9987-4f3a-af2e-92a372fdf821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e09365d-9987-4f3a-af2e-92a372fdf821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ea5fd1-ceb8-424f-8367-d57c66ca09f9', 'volume_name': 'volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80015ab2-6191-42fb-9189-f7c4c0b9ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80015ab2-6191-42fb-9189-f7c4c0b9ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d20a14-5afd-4d9f-938d-1881f9e4f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume 41ea5fd1-ceb8-424f-8367-d57c66ca09f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9', 'volume_size': 1} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:30 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7 1073741824" returned: 0 in 0.643s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:30 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7 Sep 30 10:39:30 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (43f3918e-e567-4b69-b243-8b403815a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001b8c61-cf57-45d0-a941-f315262f23d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001b8c61-cf57-45d0-a941-f315262f23d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-145009494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30b2001-2136-4eab-a580-5a592b55f2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:31Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccde6d8-a725-4de8-a18d-4c13434ec693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccde6d8-a725-4de8-a18d-4c13434ec693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8516a39-4ac9-4a64-8be4-43534c31313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8516a39-4ac9-4a64-8be4-43534c31313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30b2001-2136-4eab-a580-5a592b55f2a0', 'volume_name': 'volume-e30b2001-2136-4eab-a580-5a592b55f2a0', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d0316c-53e1-409f-bc3c-8a29cf64e4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d0316c-53e1-409f-bc3c-8a29cf64e4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233cacae-fc52-4840-bf93-394576ef53a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume e30b2001-2136-4eab-a580-5a592b55f2a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30b2001-2136-4eab-a580-5a592b55f2a0', 'volume_size': 1} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:31 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7" returned: 0 in 0.264s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.164s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1135755850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497d98e6-b3b9-447c-916f-1305705bbaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:30Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Creating volume 497d98e6-b3b9-447c-916f-1305705bbaca {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:31 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f04896a-16e7-4dbc-b75b-6cf65b7f1660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:31 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca 1073741824 Sep 30 10:39:31 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61534112-7a47-443f-b7c7-09529c2e89e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7 (dc6e7fd7-d255-4aa1-856d-521ef24deac7): created successfully Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61534112-7a47-443f-b7c7-09529c2e89e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (7b761649-9f59-486b-9b44-7af4a3e54c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-1177a313-e531-42bc-a7a4-2f5106166e86 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created volume successfully. Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb28f9d7-1f72-442c-9c06-e61391e52ccd tempest-VolumesExtendTest-286914916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:31 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca 1073741824" returned: 0 in 0.526s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:31 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca Sep 30 10:39:31 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:31 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca" returned: 0 in 0.266s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1617043268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7464f4-f41e-42d7-b722-be4d8b36e8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:30Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Creating volume 7e7464f4-f41e-42d7-b722-be4d8b36e8b4 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:31 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e659e1-8bbb-4259-b912-775b4d9a6adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497d98e6-b3b9-447c-916f-1305705bbaca', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:31 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4 1073741824 Sep 30 10:39:31 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8fce03-ace5-4f20-9157-e2f96fcd28ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume volume-497d98e6-b3b9-447c-916f-1305705bbaca (497d98e6-b3b9-447c-916f-1305705bbaca): created successfully Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8fce03-ace5-4f20-9157-e2f96fcd28ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (23042d3c-d651-4ed9-ab78-a8e451889001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-44cdd447-e374-4543-8c4b-745244418eb7 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created volume successfully. Sep 30 10:39:32 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4 1073741824" returned: 0 in 0.478s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:32 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4 Sep 30 10:39:32 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:32 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4" returned: 0 in 0.319s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.075s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1897765582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ea5fd1-ceb8-424f-8367-d57c66ca09f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:30Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Creating volume 41ea5fd1-ceb8-424f-8367-d57c66ca09f9 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:32 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4632aefe-c236-46fe-b07d-00f8c478c798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:32 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9 1073741824 Sep 30 10:39:32 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc66afc-3fea-4070-8310-596dd7a9d615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4 (7e7464f4-f41e-42d7-b722-be4d8b36e8b4): created successfully Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc66afc-3fea-4070-8310-596dd7a9d615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (f0874ca0-a2c6-4fe2-a74f-7813d0ecc25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2bac7d8b-5519-43ae-b58b-8e65ddbe22c9 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created volume successfully. Sep 30 10:39:33 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9 1073741824" returned: 0 in 0.576s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:33 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9 Sep 30 10:39:33 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:33 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9" returned: 0 in 0.296s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.656s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-145009494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30b2001-2136-4eab-a580-5a592b55f2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46fdddd2bd4988b2f5bf8c09bb93fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:31Z,use_quota=True,user_id='c7dea00809d14ede864820c63b39ae1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Creating volume e30b2001-2136-4eab-a580-5a592b55f2a0 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:33 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d20a14-5afd-4d9f-938d-1881f9e4f058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:33 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0 1073741824 Sep 30 10:39:33 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333c662f-27e5-497e-b269-4496db50a2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:33 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9 (41ea5fd1-ceb8-424f-8367-d57c66ca09f9): created successfully Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333c662f-27e5-497e-b269-4496db50a2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (7d8d254b-7b59-420e-b427-d4a332b85a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:33 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-12b3ea2e-bc90-4da7-a523-0e6c0496b5d4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created volume successfully. Sep 30 10:39:34 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0 1073741824" returned: 0 in 0.463s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:34 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0 Sep 30 10:39:34 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:34 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0" returned: 0 in 0.280s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb28f9d7-1f72-442c-9c06-e61391e52ccd tempest-VolumesExtendTest-286914916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.069s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233cacae-fc52-4840-bf93-394576ef53a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30b2001-2136-4eab-a580-5a592b55f2a0', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f5687c-2393-4620-b9bc-33ce0ff20f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c854007-b34b-475d-b443-823db1ce5f3c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb28f9d7-1f72-442c-9c06-e61391e52ccd tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:34 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Volume volume-e30b2001-2136-4eab-a580-5a592b55f2a0 (e30b2001-2136-4eab-a580-5a592b55f2a0): created successfully Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f5687c-2393-4620-b9bc-33ce0ff20f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Flow 'volume_create_manager' (43f3918e-e567-4b69-b243-8b403815a16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:34 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7fd9557c-a89d-401f-bd72-0b9dd6471de0 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created volume successfully. Sep 30 10:39:34 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 Sep 30 10:39:34 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:34 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb28f9d7-1f72-442c-9c06-e61391e52ccd tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb28f9d7-1f72-442c-9c06-e61391e52ccd tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a 2G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fb28f9d7-1f72-442c-9c06-e61391e52ccd tempest-VolumesExtendTest-286914916 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a 2G" returned: 0 in 0.141s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fb28f9d7-1f72-442c-9c06-e61391e52ccd tempest-VolumesExtendTest-286914916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.576s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fb28f9d7-1f72-442c-9c06-e61391e52ccd tempest-VolumesExtendTest-286914916 None] Extend volume completed successfully. Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-e30b2001-2136-4eab-a580-5a592b55f2a0-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-e30b2001-2136-4eab-a580-5a592b55f2a0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-quobyte-e30b2001-2136-4eab-a580-5a592b55f2a0" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-e30b2001-2136-4eab-a580-5a592b55f2a0" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e8c63-3ca3-4b4f-8863-381f83825b77]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:35 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0 Sep 30 10:39:35 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Acquiring lock "cinder-8f8191a3-2e88-472c-b1ac-28ff638e0d9a-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Lock "cinder-8f8191a3-2e88-472c-b1ac-28ff638e0d9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Acquiring lock "cinder-quobyte-33e748ba-6a01-450e-ac37-a03ca59611a1" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Lock "cinder-quobyte-33e748ba-6a01-450e-ac37-a03ca59611a1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Acquiring lock "cinder-quobyte-8f8191a3-2e88-472c-b1ac-28ff638e0d9a" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Lock "cinder-quobyte-8f8191a3-2e88-472c-b1ac-28ff638e0d9a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Deleting offline snapshot 8f8191a3-2e88-472c-b1ac-28ff638e0d9a of volume 33e748ba-6a01-450e-ac37-a03ca59611a1 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] snapshot_file for this snap is: volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[54edac03-6bcc-4ca8-ba7e-888ec720eea7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:36 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0" returned: 0 in 0.439s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:36 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0 Sep 30 10:39:36 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:36 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a Sep 30 10:39:36 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:36 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e30b2001-2136-4eab-a580-5a592b55f2a0" returned: 0 in 0.283s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-e30b2001-2136-4eab-a580-5a592b55f2a0" released by "delete_volume" :: held 0.783s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created reservations ['22333a00-9753-4ee1-a4b6-351083bbc69d', '310f839e-ece9-450e-a854-e5f5ac46121c', 'decabfdb-d5f7-4bfb-bebb-73000f39cf88', '8c9db5ee-bf3e-4fd5-b915-65c050ce2249'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:36 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a" returned: 0 in 0.407s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33e748ba-6a01-450e-ac37-a03ca59611a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7ad5a1-8e7b-4dd2-8a32-f73124f93235]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:36 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:36 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:36 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 Sep 30 10:39:36 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-41ea5fd1-ceb8-424f-8367-d57c66ca09f9-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-41ea5fd1-ceb8-424f-8367-d57c66ca09f9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-quobyte-41ea5fd1-ceb8-424f-8367-d57c66ca09f9" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-41ea5fd1-ceb8-424f-8367-d57c66ca09f9" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:36 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.303s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:36 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Deleted volume successfully. Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfe76a0-fa83-400b-a7ad-713fa7196bd8]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b112f5a0-b994-4185-9c08-a3d7fa065fe4 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-e30b2001-2136-4eab-a580-5a592b55f2a0-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:36 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1" returned: 0 in 0.467s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:36 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a Sep 30 10:39:36 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:37 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9 Sep 30 10:39:37 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:37 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:37 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:37 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9" returned: 0 in 0.412s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:37 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9 Sep 30 10:39:37 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:37 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:39:37 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a" returned: 0 in 0.485s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:37 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a Sep 30 10:39:37 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:37 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41ea5fd1-ceb8-424f-8367-d57c66ca09f9" returned: 0 in 0.299s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-41ea5fd1-ceb8-424f-8367-d57c66ca09f9" released by "delete_volume" :: held 0.776s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created reservations ['e7f1a51f-54e4-4f5a-9dce-e64ff8c53c7e', '93566a81-d886-4acc-847e-d71a0dd9db19', '937715a0-1676-430a-b232-6e9b6441e223', '6a3f57c3-bf42-424e-9c4f-fa0b8cd3b655'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:37 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1.8f8191a3-2e88-472c-b1ac-28ff638e0d9a" returned: 0 in 0.283s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:37 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:37 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Lock "cinder-quobyte-8f8191a3-2e88-472c-b1ac-28ff638e0d9a" released by "_delete_snapshot" :: held 1.796s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Lock "cinder-quobyte-33e748ba-6a01-450e-ac37-a03ca59611a1" released by "delete_snapshot" :: held 1.828s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:37 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Created reservations ['a457d923-6455-4428-8812-7d1f17191de8', '0cdb2036-3f24-4d5d-a468-c3f81fc85ce9', '25423ea0-088f-44c8-a494-f2cf6d215090', 'c254c163-ac70-4227-91ee-a0cbf86ba5ec'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:37 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Delete snapshot completed successfully. Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-23d0040a-252e-4589-a6e3-0ac1b9baeab6 tempest-VolumesExtendTest-286914916 None] Lock "cinder-8f8191a3-2e88-472c-b1ac-28ff638e0d9a-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-7e7464f4-f41e-42d7-b722-be4d8b36e8b4-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-7e7464f4-f41e-42d7-b722-be4d8b36e8b4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-quobyte-7e7464f4-f41e-42d7-b722-be4d8b36e8b4" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-7e7464f4-f41e-42d7-b722-be4d8b36e8b4" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:38 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.398s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Deleted volume successfully. Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c834e08-8f45-408a-951d-073185917ec7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-937e6433-ae1d-4a2a-95f8-e1a3ff005e1c tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-41ea5fd1-ceb8-424f-8367-d57c66ca09f9-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Acquiring lock "cinder-33e748ba-6a01-450e-ac37-a03ca59611a1-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Lock "cinder-33e748ba-6a01-450e-ac37-a03ca59611a1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:38 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4 Sep 30 10:39:38 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Acquiring lock "cinder-quobyte-33e748ba-6a01-450e-ac37-a03ca59611a1" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Lock "cinder-quobyte-33e748ba-6a01-450e-ac37-a03ca59611a1" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3487be20-f428-4565-bfb0-0c7a8b498d0a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:38 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 Sep 30 10:39:38 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:38 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4" returned: 0 in 0.463s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:38 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4 Sep 30 10:39:38 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:38 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1" returned: 0 in 0.420s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:38 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1 Sep 30 10:39:38 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:38 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7e7464f4-f41e-42d7-b722-be4d8b36e8b4" returned: 0 in 0.291s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-7e7464f4-f41e-42d7-b722-be4d8b36e8b4" released by "delete_volume" :: held 0.817s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:38 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created reservations ['8d1e3400-1401-4806-b590-d55cfb430a00', 'fc2ff7f0-1abf-47c8-b708-3a2fce2bdb57', '3155f079-b965-4275-9ccf-be38a01bf56e', '6d6e98a8-eed4-4471-8bad-86ca08326cea'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:39 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:39 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:39 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-33e748ba-6a01-450e-ac37-a03ca59611a1" returned: 0 in 0.273s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Lock "cinder-quobyte-33e748ba-6a01-450e-ac37-a03ca59611a1" released by "delete_volume" :: held 0.779s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Created reservations ['88644ffe-c408-486d-9c78-c577efe3d406', 'a45b4f3d-d550-4c3c-b920-c50139e84ce8', '65c63a9c-54a4-4fb2-bfec-1e87ec2af00e', '90fc88ef-45ce-49e1-80f5-56ead7284be5'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-497d98e6-b3b9-447c-916f-1305705bbaca-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-497d98e6-b3b9-447c-916f-1305705bbaca-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:39 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-quobyte-497d98e6-b3b9-447c-916f-1305705bbaca" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.426s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:39 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:39 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Deleted volume successfully. Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-497d98e6-b3b9-447c-916f-1305705bbaca" acquired by "delete_volume" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-303d0f68-bd12-4fe8-b3af-4c823b319d53 tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-7e7464f4-f41e-42d7-b722-be4d8b36e8b4-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fee1f93-04fe-43ca-bf3c-9b9b63d14361]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:39 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca Sep 30 10:39:39 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:39 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.341s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Deleted volume successfully. Sep 30 10:39:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2fd47557-1809-46a1-8bef-413e2e306bcd tempest-VolumesExtendTest-286914916 None] Lock "cinder-33e748ba-6a01-450e-ac37-a03ca59611a1-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:40 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca" returned: 0 in 0.488s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:40 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca Sep 30 10:39:40 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:40 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-497d98e6-b3b9-447c-916f-1305705bbaca" returned: 0 in 0.306s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-497d98e6-b3b9-447c-916f-1305705bbaca" released by "delete_volume" :: held 0.874s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created reservations ['6c4a5592-000d-47cc-aae8-678829dd881b', '64ea2586-54d6-4960-b41f-2df4ca5a5bd5', 'adf4873a-5f50-4264-a8bf-443f59127215', '11113b06-2f16-43d4-b5f3-b52ac8162f62'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:40 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:40 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:40 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.305s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Deleted volume successfully. Sep 30 10:39:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-026de023-c630-4706-ab22-46e94b87bccf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-497d98e6-b3b9-447c-916f-1305705bbaca-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Flow 'volume_create_manager' (ca8f83ed-bc0b-426d-8d62-f241138431d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12aa92d4-3385-4c6e-8449-b288f84c0db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12aa92d4-3385-4c6e-8449-b288f84c0db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1130238318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868847f4-7c4f-4c7a-aa7c-63deaa961de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d564460ebb1f493aa910934ac69b67b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:41Z,use_quota=True,user_id='1cbef9f4126644daac5724eca50b396d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ed7433-2c37-488a-a3f5-d2ad7590bac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ed7433-2c37-488a-a3f5-d2ad7590bac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2def07be-00be-44d3-804f-d83f882e3aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2def07be-00be-44d3-804f-d83f882e3aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868847f4-7c4f-4c7a-aa7c-63deaa961de4', 'volume_name': 'volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4adf9992-39a0-4edb-a3db-c0b8bcea8d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4adf9992-39a0-4edb-a3db-c0b8bcea8d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10235a29-0412-456a-8a20-b74db1ae61a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:41 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Volume 868847f4-7c4f-4c7a-aa7c-63deaa961de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4', 'volume_size': 1} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1130238318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868847f4-7c4f-4c7a-aa7c-63deaa961de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d564460ebb1f493aa910934ac69b67b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:41Z,use_quota=True,user_id='1cbef9f4126644daac5724eca50b396d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Creating volume 868847f4-7c4f-4c7a-aa7c-63deaa961de4 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:41 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:41 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 1073741824 Sep 30 10:39:41 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-dc6e7fd7-d255-4aa1-856d-521ef24deac7-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-dc6e7fd7-d255-4aa1-856d-521ef24deac7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-quobyte-dc6e7fd7-d255-4aa1-856d-521ef24deac7" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-dc6e7fd7-d255-4aa1-856d-521ef24deac7" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ebc9b6-0f60-4bf2-a578-41148a5c015d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:41 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 1073741824" returned: 0 in 0.555s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:41 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7 Sep 30 10:39:41 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:41 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 Sep 30 10:39:41 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:42 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4" returned: 0 in 0.271s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10235a29-0412-456a-8a20-b74db1ae61a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ffb5ac-eec0-43af-915b-3b39abd92386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:42 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Volume volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 (868847f4-7c4f-4c7a-aa7c-63deaa961de4): created successfully Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ffb5ac-eec0-43af-915b-3b39abd92386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:42 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Flow 'volume_create_manager' (ca8f83ed-bc0b-426d-8d62-f241138431d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7" returned: 0 in 0.437s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:42 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0b813f77-1f92-4925-8146-d94e2bc6e360 tempest-TestImageHashVerification-1091747 None] Created volume successfully. Sep 30 10:39:42 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7 Sep 30 10:39:42 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:42 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc6e7fd7-d255-4aa1-856d-521ef24deac7" returned: 0 in 0.257s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-dc6e7fd7-d255-4aa1-856d-521ef24deac7" released by "delete_volume" :: held 0.746s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created reservations ['a0f8a2e9-c7a5-409b-b149-c1b332c0edf5', '4713caba-2721-4ed2-b15a-ceec20ae6c41', 'fcf7cd1b-2d4b-4825-958f-654d1b3c1dce', 'afe43d5e-4a77-4411-9087-4e089bdc0ba8'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:42 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:42 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:42 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-dbad481f-6016-423d-8b1e-2d8385c49000-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.259s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:42 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Deleted volume successfully. Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-dbad481f-6016-423d-8b1e-2d8385c49000-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-4c1fc244-96ea-4011-953e-8dec891720fe tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-dc6e7fd7-d255-4aa1-856d-521ef24deac7-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "cinder-quobyte-dbad481f-6016-423d-8b1e-2d8385c49000" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-dbad481f-6016-423d-8b1e-2d8385c49000" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3f0ec4-28f9-4c89-b968-fd8f42095561]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:43 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000 Sep 30 10:39:43 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:43 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000" returned: 0 in 0.385s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:43 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000 Sep 30 10:39:43 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:43 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dbad481f-6016-423d-8b1e-2d8385c49000" returned: 0 in 0.315s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-quobyte-dbad481f-6016-423d-8b1e-2d8385c49000" released by "delete_volume" :: held 0.758s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (39ed9267-e75c-4a31-ac85-07a57b00f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (441f15fc-732e-4060-8b07-3b546e778215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (441f15fc-732e-4060-8b07-3b546e778215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1746131481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cba30e-a117-4fc9-9f59-3b60610389ed,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:44Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bbe905-3520-4b52-a483-17293139f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bbe905-3520-4b52-a483-17293139f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f2da7c-0f3d-4603-baed-c78ff3b8b3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f2da7c-0f3d-4603-baed-c78ff3b8b3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73cba30e-a117-4fc9-9f59-3b60610389ed', 'volume_name': 'volume-73cba30e-a117-4fc9-9f59-3b60610389ed', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d35f882-e29a-4806-9103-4d225866fa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d35f882-e29a-4806-9103-4d225866fa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bdaa79-cfaa-4c53-9830-e98ede3ea793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:43 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Volume 73cba30e-a117-4fc9-9f59-3b60610389ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73cba30e-a117-4fc9-9f59-3b60610389ed', 'volume_size': 1} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1746131481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cba30e-a117-4fc9-9f59-3b60610389ed,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:44Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Creating volume 73cba30e-a117-4fc9-9f59-3b60610389ed {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:39:43 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:43 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed 1073741824 Sep 30 10:39:43 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Created reservations ['d3aff93d-0b35-4c37-84c8-ad1e20a8b479', 'e697ffab-2718-43a4-9faa-2a4c8d65d563', 'dd1e1c48-f2ea-4545-9ab5-497fc19357b0', '6f915c91-5451-47a2-82c8-5dc59a4e0eee'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:43 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:39:43 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:44 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.331s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:39:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Deleted volume successfully. Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21ab1f61-369b-4337-9eaf-c1a8c92f51cf tempest-CreateVolumesFromSourceVolumeTest-1503317234 None] Lock "cinder-dbad481f-6016-423d-8b1e-2d8385c49000-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:39:44 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed 1073741824" returned: 0 in 0.538s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:44 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed Sep 30 10:39:44 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:44 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed" returned: 0 in 0.266s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.442s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bdaa79-cfaa-4c53-9830-e98ede3ea793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73cba30e-a117-4fc9-9f59-3b60610389ed', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68142ef8-4125-4e87-ba75-a19fac11c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c55fc7c-b1c0-4f59-8c4e-a0b832ec3a3a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:44 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Volume volume-73cba30e-a117-4fc9-9f59-3b60610389ed (73cba30e-a117-4fc9-9f59-3b60610389ed): created successfully Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68142ef8-4125-4e87-ba75-a19fac11c516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (39ed9267-e75c-4a31-ac85-07a57b00f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e0f2dace-44f2-4ea2-8af7-ea891c445c55 tempest-VolumesGetTest-1184241256 None] Created volume successfully. Sep 30 10:39:44 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 Sep 30 10:39:44 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:45 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4" returned: 0 in 0.380s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:45 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[72297c47-21a0-48ee-a5e8-3688ee2fcc40]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:45 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 Sep 30 10:39:45 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:45 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4" returned: 0 in 0.410s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 /opt/stack/data/cinder/conversion/868847f4-7c4f-4c7a-aa7c-63deaa961de4.temp_image.b91bae9a-25ee-41e1-9ee9-e729dc3435f6s37q28r5.img {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:45 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 /opt/stack/data/cinder/conversion/868847f4-7c4f-4c7a-aa7c-63deaa961de4.temp_image.b91bae9a-25ee-41e1-9ee9-e729dc3435f6s37q28r5.img Sep 30 10:39:45 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:47 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (10fb0e0f-54f0-45a1-9df5-4204e178956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270f5205-6c9c-46b4-9f0b-4c73d0e54485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270f5205-6c9c-46b4-9f0b-4c73d0e54485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1935620430',display_name='tempest-VolumesGetTest-Volume-1394628287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31429de-b72c-4cda-a64e-60030d086d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:48Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e96c4c-c18d-4f03-b228-e4645d0ea8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e96c4c-c18d-4f03-b228-e4645d0ea8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddd2ff6-39b9-4dc2-bfef-81824580de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddd2ff6-39b9-4dc2-bfef-81824580de96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31429de-b72c-4cda-a64e-60030d086d36', 'volume_name': 'volume-e31429de-b72c-4cda-a64e-60030d086d36', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe09f61-ecdd-40b1-b6df-02050855e3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe09f61-ecdd-40b1-b6df-02050855e3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b79a9ff-82b6-4785-b958-2b204e6136c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:48 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Volume e31429de-b72c-4cda-a64e-60030d086d36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31429de-b72c-4cda-a64e-60030d086d36', 'volume_size': 1} Sep 30 10:39:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Flow 'volume_create_manager' (88a8c460-e57a-403f-b03d-fa581bbd1fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a074e10-a869-45a2-8f82-09d7d9c31ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a074e10-a869-45a2-8f82-09d7d9c31ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-738747296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1107f78986d4d759454f5f63b0901cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:50Z,use_quota=True,user_id='9d00d77ef8a547e1b37bbfd60a31c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fd7797-e3c5-45d7-9ce9-0576f6d81281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fd7797-e3c5-45d7-9ce9-0576f6d81281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfddded-4269-4d54-a996-7aa00e37bf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfddded-4269-4d54-a996-7aa00e37bf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed', 'volume_name': 'volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b5c0cd-7e68-4c58-98dd-3e64b8c08c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b5c0cd-7e68-4c58-98dd-3e64b8c08c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff9f316-87f4-469e-a934-6e174bb79978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:39:49 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Volume 99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed', 'volume_size': 1} Sep 30 10:39:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:39:51 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 /opt/stack/data/cinder/conversion/868847f4-7c4f-4c7a-aa7c-63deaa961de4.temp_image.b91bae9a-25ee-41e1-9ee9-e729dc3435f6s37q28r5.img" returned: 0 in 6.403s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:51 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd65532-c630-415a-be5a-b0ea27fbfef7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:39:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:39:52 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 Sep 30 10:39:52 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:39:52 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 30 10:39:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4" returned: 0 in 0.492s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:39:52 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/conversion/868847f4-7c4f-4c7a-aa7c-63deaa961de4.temp_image.b91bae9a-25ee-41e1-9ee9-e729dc3435f6s37q28r5.img {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:39:52 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Converted 1024.00 MB image at 159.91 MB/s Sep 30 10:39:52 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] b91bae9a-25ee-41e1-9ee9-e729dc3435f6 was raw, no need to convert to raw {{(pid=87013) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 30 10:39:59 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=123,cinder:UPDATE=153,cinder:DELETE=17,cinder:INSERT=46 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:40:02 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=113,cinder:UPDATE=174,cinder:INSERT=39,cinder:DELETE=12 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.785s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Uploaded volume to glance image-id: b91bae9a-25ee-41e1-9ee9-e729dc3435f6. {{(pid=87013) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.363s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1935620430',display_name='tempest-VolumesGetTest-Volume-1394628287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31429de-b72c-4cda-a64e-60030d086d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:48Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Creating volume e31429de-b72c-4cda-a64e-60030d086d36 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:40:11 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:11 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36 1073741824 Sep 30 10:40:11 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:11 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-455382c5-2f09-44c4-9318-e47bbce9d6bb tempest-TestImageHashVerification-1091747 None] Copy volume to image completed successfully. Sep 30 10:40:11 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36 1073741824" returned: 0 in 0.429s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:11 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36 Sep 30 10:40:11 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:12 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36" returned: 0 in 0.236s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.424s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-738747296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1107f78986d4d759454f5f63b0901cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:39:50Z,use_quota=True,user_id='9d00d77ef8a547e1b37bbfd60a31c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Creating volume 99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:40:12 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b79a9ff-82b6-4785-b958-2b204e6136c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31429de-b72c-4cda-a64e-60030d086d36', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:12 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed 1073741824 Sep 30 10:40:12 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878581ac-a5ef-4df5-914e-7e234fb1c16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:12 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Volume volume-e31429de-b72c-4cda-a64e-60030d086d36 (e31429de-b72c-4cda-a64e-60030d086d36): created successfully Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878581ac-a5ef-4df5-914e-7e234fb1c16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (10fb0e0f-54f0-45a1-9df5-4204e178956d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-4bb7b880-f706-44b1-b52d-f35486a47ad2 tempest-VolumesGetTest-1184241256 None] Created volume successfully. Sep 30 10:40:12 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed 1073741824" returned: 0 in 0.436s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:12 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed Sep 30 10:40:12 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Acquiring lock "cinder-868847f4-7c4f-4c7a-aa7c-63deaa961de4-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Lock "cinder-868847f4-7c4f-4c7a-aa7c-63deaa961de4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Acquiring lock "cinder-quobyte-868847f4-7c4f-4c7a-aa7c-63deaa961de4" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Lock "cinder-quobyte-868847f4-7c4f-4c7a-aa7c-63deaa961de4" acquired by "delete_volume" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:12 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4c9f7c-b00b-4891-89b9-38a0cf8a37c1]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed" returned: 0 in 0.275s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff9f316-87f4-469e-a934-6e174bb79978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075eea46-f2d5-4d24-af29-729ff2cf9aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:12 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Volume volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed (99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed): created successfully Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075eea46-f2d5-4d24-af29-729ff2cf9aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Flow 'volume_create_manager' (88a8c460-e57a-403f-b03d-fa581bbd1fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3a8e34de-9f73-4993-b654-cc234ecbef39 tempest-ProjectReaderTests-1003756533 None] Created volume successfully. Sep 30 10:40:13 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 Sep 30 10:40:13 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:13 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4" returned: 0 in 0.375s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:13 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4 Sep 30 10:40:13 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-e31429de-b72c-4cda-a64e-60030d086d36-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Lock "cinder-e31429de-b72c-4cda-a64e-60030d086d36-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-quobyte-e31429de-b72c-4cda-a64e-60030d086d36" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-e31429de-b72c-4cda-a64e-60030d086d36" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6c3741-012e-4a37-9fb1-8fadbe6ff789]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:13 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-868847f4-7c4f-4c7a-aa7c-63deaa961de4" returned: 0 in 0.265s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Lock "cinder-quobyte-868847f4-7c4f-4c7a-aa7c-63deaa961de4" released by "delete_volume" :: held 0.692s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Created reservations ['843095f8-654a-4818-aa2f-871d1264fefd', 'd5cf1371-14e0-48bc-b32b-c9011be383e4', '0a97ea57-c785-403e-96eb-1dd10b4337a8', '1f42c6c3-5af3-4315-b7ec-667b05696282'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:13 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36 Sep 30 10:40:13 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:13 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:13 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:13 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36" returned: 0 in 0.375s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:13 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36 Sep 30 10:40:13 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:13 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.278s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:13 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Deleted volume successfully. Sep 30 10:40:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-97add211-72af-4fd7-93b7-fbfc4c4ff21b tempest-TestImageHashVerification-1091747 None] Lock "cinder-868847f4-7c4f-4c7a-aa7c-63deaa961de4-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:14 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-e31429de-b72c-4cda-a64e-60030d086d36" returned: 0 in 0.271s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-e31429de-b72c-4cda-a64e-60030d086d36" released by "delete_volume" :: held 0.688s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Acquiring lock "cinder-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Lock "cinder-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Created reservations ['defc4d1a-47df-41fd-90a4-832f4ab6ece5', '2824f033-e7dd-4328-b6d0-fe5fcbd0ba29', '31e3b477-973c-4705-9da2-5de6c4bcecff', 'ccfcee12-0166-4617-9e41-b88e3679a390'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Acquiring lock "cinder-quobyte-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Lock "cinder-quobyte-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa4020a-2e07-435c-81bd-f0035ad4fd34]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:14 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:14 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:14 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed Sep 30 10:40:14 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:14 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-73cba30e-a117-4fc9-9f59-3b60610389ed-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.295s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:14 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Deleted volume successfully. Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Lock "cinder-73cba30e-a117-4fc9-9f59-3b60610389ed-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d279ac7b-68fb-4363-a50a-b780931ffd3f tempest-VolumesGetTest-1184241256 None] Lock "cinder-e31429de-b72c-4cda-a64e-60030d086d36-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-quobyte-73cba30e-a117-4fc9-9f59-3b60610389ed" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-73cba30e-a117-4fc9-9f59-3b60610389ed" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[febbdb8a-0683-40e0-ab87-efa912bbd93b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:14 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed" returned: 0 in 0.497s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:14 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed Sep 30 10:40:14 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:14 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed Sep 30 10:40:14 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:15 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed" returned: 0 in 0.272s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Lock "cinder-quobyte-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed" released by "delete_volume" :: held 0.844s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Created reservations ['56dc2176-8f59-42d8-8ab1-335b4af7e904', '1590d7bc-cab3-47a2-9773-3724dff6be5c', '092b40a3-507e-4863-897a-f65a3f68bd7c', '126bd284-d36a-410e-a994-3cb39cf26e7d'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:15 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed" returned: 0 in 0.402s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:15 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed Sep 30 10:40:15 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:15 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:15 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:15 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-73cba30e-a117-4fc9-9f59-3b60610389ed" returned: 0 in 0.371s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-73cba30e-a117-4fc9-9f59-3b60610389ed" released by "delete_volume" :: held 0.848s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:15 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.354s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:15 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Deleted volume successfully. Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fc8c3492-f076-4326-8dec-6c964792331f tempest-ProjectReaderTests-1003756533 None] Lock "cinder-99e57dfa-a4d1-4ad7-88a1-4b4e0be87bed-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Created reservations ['33142c7c-e118-481b-bf11-563d7b2f6aee', '46ce0349-d029-4985-a7e1-66b1be0b075b', '0a2d1907-7648-4610-8202-b2ece54994a3', '0e5be232-57f8-4673-80ca-0be19ee1818c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:15 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:15 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:15 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Flow 'volume_create_manager' (f0890b58-95d6-4acb-86b6-fc8743f25c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e12ce2-9ff5-4cc3-85ac-300317301a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e12ce2-9ff5-4cc3-85ac-300317301a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919290155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc0d3d0-471f-4c0f-91e0-749d50be8c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1107f78986d4d759454f5f63b0901cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:16Z,use_quota=True,user_id='9d00d77ef8a547e1b37bbfd60a31c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87dfcc30-a40c-4296-9220-77b7dbaec166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87dfcc30-a40c-4296-9220-77b7dbaec166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a52ea45-2045-4df3-adb8-08ed0b803460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a52ea45-2045-4df3-adb8-08ed0b803460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc0d3d0-471f-4c0f-91e0-749d50be8c04', 'volume_name': 'volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8b5ca5-7bca-4649-b0a5-c25e1b541f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8b5ca5-7bca-4649-b0a5-c25e1b541f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7a37fe-bdf4-4bb1-aba1-5eeb1d7a8e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Volume dfc0d3d0-471f-4c0f-91e0-749d50be8c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04', 'volume_size': 1} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919290155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc0d3d0-471f-4c0f-91e0-749d50be8c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1107f78986d4d759454f5f63b0901cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:16Z,use_quota=True,user_id='9d00d77ef8a547e1b37bbfd60a31c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Creating volume dfc0d3d0-471f-4c0f-91e0-749d50be8c04 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:40:16 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:16 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04 1073741824 Sep 30 10:40:16 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:16 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.293s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:16 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Deleted volume successfully. Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-b71afc7e-6ffd-44d5-9b0e-e2b5a4c868cc tempest-VolumesGetTest-1184241256 None] Lock "cinder-73cba30e-a117-4fc9-9f59-3b60610389ed-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (bd44ccd3-c0ca-45e9-85ab-82b948476c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1444887c-f060-433e-80ec-f75b8f613147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1444887c-f060-433e-80ec-f75b8f613147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1835562323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9ce04a-daa6-46ac-8e56-3fe0a207a631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:16Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a79375-fb74-4837-8eff-4411bcdba20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a79375-fb74-4837-8eff-4411bcdba20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6001baa-cb0a-4e35-81c4-639283b0308e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6001baa-cb0a-4e35-81c4-639283b0308e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f9ce04a-daa6-46ac-8e56-3fe0a207a631', 'volume_name': 'volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16636fe6-1fb2-49e3-a04f-5cfbafe375c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16636fe6-1fb2-49e3-a04f-5cfbafe375c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa96568d-f507-4d51-b9c9-88591a2b153b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Volume 4f9ce04a-daa6-46ac-8e56-3fe0a207a631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631', 'volume_size': 1} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:16 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04 1073741824" returned: 0 in 0.516s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:16 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04 Sep 30 10:40:16 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:16 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04" returned: 0 in 0.271s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1835562323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9ce04a-daa6-46ac-8e56-3fe0a207a631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:16Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Creating volume 4f9ce04a-daa6-46ac-8e56-3fe0a207a631 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:40:16 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7a37fe-bdf4-4bb1-aba1-5eeb1d7a8e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1a51b5-7d9d-4127-bff9-c6c67e398e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:16 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 1073741824 Sep 30 10:40:16 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:16 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Volume volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04 (dfc0d3d0-471f-4c0f-91e0-749d50be8c04): created successfully Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1a51b5-7d9d-4127-bff9-c6c67e398e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Flow 'volume_create_manager' (f0890b58-95d6-4acb-86b6-fc8743f25c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:16 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fe7b9cf4-3925-4fa7-9978-b068d068a2b2 tempest-ProjectReaderTests-1003756533 None] Created volume successfully. Sep 30 10:40:17 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 1073741824" returned: 0 in 0.423s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:17 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 Sep 30 10:40:17 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:17 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631" returned: 0 in 0.247s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:40:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa96568d-f507-4d51-b9c9-88591a2b153b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37b7996-756a-43aa-82ab-6a4ccec1c9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:17 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Volume volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 (4f9ce04a-daa6-46ac-8e56-3fe0a207a631): created successfully Sep 30 10:40:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37b7996-756a-43aa-82ab-6a4ccec1c9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (bd44ccd3-c0ca-45e9-85ab-82b948476c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:17 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-75606c2c-276e-4ccb-877f-f5bd843e7525 tempest-VolumesGetTest-1184241256 None] Created volume successfully. Sep 30 10:40:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Acquiring lock "cinder-dfc0d3d0-471f-4c0f-91e0-749d50be8c04-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Lock "cinder-dfc0d3d0-471f-4c0f-91e0-749d50be8c04-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Acquiring lock "cinder-quobyte-dfc0d3d0-471f-4c0f-91e0-749d50be8c04" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Lock "cinder-quobyte-dfc0d3d0-471f-4c0f-91e0-749d50be8c04" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:18 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a31dda1-1027-443a-967b-02bac18412b7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:18 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04 Sep 30 10:40:18 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:18 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04" returned: 0 in 0.524s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:18 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04 Sep 30 10:40:18 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:19 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dfc0d3d0-471f-4c0f-91e0-749d50be8c04" returned: 0 in 0.369s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Lock "cinder-quobyte-dfc0d3d0-471f-4c0f-91e0-749d50be8c04" released by "delete_volume" :: held 0.948s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Created reservations ['3536422c-bd83-40da-8280-316b73a8d5c3', 'f9de9143-c749-41ce-b99f-962044d6741f', '97b56ffc-39ec-44e3-bf2b-7adb5b333b5a', '7c455022-2955-4ba8-b980-f72a34f7f0b0'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (943352f5-fd2f-4b73-9f3c-8afab776fc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f8d2d0-ac21-48ac-93f3-48ab796873b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f8d2d0-ac21-48ac-93f3-48ab796873b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-198612666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c03c17e-41c7-46cc-9459-fc2b0d87a9db,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4f9ce04a-daa6-46ac-8e56-3fe0a207a631,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:19Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb1c9ed-3396-4ec4-add5-892294b6da6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb1c9ed-3396-4ec4-add5-892294b6da6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b116ad4-2333-42df-8fb0-0518d149b237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b116ad4-2333-42df-8fb0-0518d149b237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0c03c17e-41c7-46cc-9459-fc2b0d87a9db', 'volume_name': 'volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db', 'volume_size': 1, 'source_volid': '4f9ce04a-daa6-46ac-8e56-3fe0a207a631', 'source_volstatus': 'available'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e03dca4-691b-409a-9785-756dce80f63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e03dca4-691b-409a-9785-756dce80f63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8ee875-e38b-454e-94fb-cd6b2b51b582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:19 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Volume 0c03c17e-41c7-46cc-9459-fc2b0d87a9db: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db', 'volume_size': 1, 'source_volid': '4f9ce04a-daa6-46ac-8e56-3fe0a207a631', 'source_volstatus': 'available'} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:19 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Cloning volume 4f9ce04a-daa6-46ac-8e56-3fe0a207a631 to volume 0c03c17e-41c7-46cc-9459-fc2b0d87a9db Sep 30 10:40:19 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:19 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Creating offline snapshot 6e0a903c-cfba-4d39-a21e-3b5d26872912 of volume 4f9ce04a-daa6-46ac-8e56-3fe0a207a631 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2d0c51-bd48-46f2-8352-7c2f7a4dbd54]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:19 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 Sep 30 10:40:19 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:19 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.290s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:19 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Deleted volume successfully. Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-79b7b021-ac01-4210-9cee-0621cb960a84 tempest-ProjectReaderTests-1003756533 None] Lock "cinder-dfc0d3d0-471f-4c0f-91e0-749d50be8c04-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:19 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631" returned: 0 in 0.447s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:19 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 1G Sep 30 10:40:19 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:20 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 1G" returned: 0 in 0.461s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:20 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 Sep 30 10:40:20 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:20 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912" returned: 0 in 0.351s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:20 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 is being set with open permissions: ugo+rw Sep 30 10:40:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:20 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 Sep 30 10:40:20 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:20 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912" returned: 0 in 0.261s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:20 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.info Sep 30 10:40:20 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:21 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.info" returned: 0 in 0.292s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:21 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.info is being set with open permissions: ugo+rw Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:21 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.info Sep 30 10:40:21 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:21 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.info" returned: 0 in 0.303s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-quobyte-0c03c17e-41c7-46cc-9459-fc2b0d87a9db" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-0c03c17e-41c7-46cc-9459-fc2b0d87a9db" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] snapshot: 6e0a903c-cfba-4d39-a21e-3b5d26872912, volume: 0c03c17e-41c7-46cc-9459-fc2b0d87a9db, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccafa5d-5c13-49f4-92b8-8d18855b7a33]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:21 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 Sep 30 10:40:21 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:22 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:40:22 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec977f7-191b-4e00-934f-5d36cd44691b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:22 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 Sep 30 10:40:22 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:22 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631" returned: 0 in 0.408s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:40:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:40:22 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:40:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:22 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db Sep 30 10:40:22 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:29 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db" returned: 0 in 6.944s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631, size 1024.00 MB, duration 6.94 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:40:29 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Converted 1024.00 MB image at 147.45 MB/s Sep 30 10:40:29 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db is being set with open permissions: ugo+rw Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:29 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db Sep 30 10:40:29 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:29 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db" returned: 0 in 0.235s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-0c03c17e-41c7-46cc-9459-fc2b0d87a9db" released by "_copy_volume_from_snapshot" :: held 8.069s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-quobyte-6e0a903c-cfba-4d39-a21e-3b5d26872912" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-6e0a903c-cfba-4d39-a21e-3b5d26872912" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Deleting offline snapshot 6e0a903c-cfba-4d39-a21e-3b5d26872912 of volume 4f9ce04a-daa6-46ac-8e56-3fe0a207a631 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] snapshot_file for this snap is: volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e645df-185b-4520-b608-0794213ecf64]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:29 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 Sep 30 10:40:29 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:30 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:40:30 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[967df3b7-382f-4ba0-9a7f-8f16b45eea11]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:30 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 Sep 30 10:40:30 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:30 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631" returned: 0 in 0.560s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:30 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 Sep 30 10:40:30 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:30 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=31,cinder:UPDATE=55,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:40:31 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912" returned: 0 in 0.345s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:31 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912 Sep 30 10:40:31 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:31 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631.6e0a903c-cfba-4d39-a21e-3b5d26872912" returned: 0 in 0.254s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-6e0a903c-cfba-4d39-a21e-3b5d26872912" released by "_delete_snapshot" :: held 1.644s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.070s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8ee875-e38b-454e-94fb-cd6b2b51b582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db', 'volume_size': 1, 'source_volid': '4f9ce04a-daa6-46ac-8e56-3fe0a207a631', 'source_volstatus': 'available'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43f4f39-6a0e-4ec3-af61-b584f9a0b087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Volume volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db (0c03c17e-41c7-46cc-9459-fc2b0d87a9db): created successfully Sep 30 10:40:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43f4f39-6a0e-4ec3-af61-b584f9a0b087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (943352f5-fd2f-4b73-9f3c-8afab776fc0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e45d4d5b-03e3-4682-9353-2d8e99047440 tempest-VolumesGetTest-1184241256 None] Created volume successfully. Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Flow 'volume_create_manager' (1e40d33f-a79b-47ea-a746-2228133a6ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7f5e10-42c6-4aa5-b029-02636e1576e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7f5e10-42c6-4aa5-b029-02636e1576e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2e81ac-eb62-4828-9aa7-d3515da8a57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bfabb779c7b416aaccd6c0afdba3918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:32Z,use_quota=True,user_id='325e0ebd1e73475a919b5a37434781fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(470e4a67-c33f-4096-a6f7-1688cd5ac0b3),volume_type_id=470e4a67-c33f-4096-a6f7-1688cd5ac0b3)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ce00f3-2de2-4810-ad6d-da29eedc04e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ce00f3-2de2-4810-ad6d-da29eedc04e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2f0ee5-65e5-4dbf-8df3-2e987e8cadd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.image.glance [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Creating Keystone auth plugin from conf {{(pid=87013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2f0ee5-65e5-4dbf-8df3-2e987e8cadd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d2e81ac-eb62-4828-9aa7-d3515da8a57b', 'volume_name': 'volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b', 'volume_size': 1, 'image_id': '590a83bb-5cec-480d-834e-f539c8794c34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/590a83bb-5cec-480d-834e-f539c8794c34', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc95f3eedd5fc0f7f52484d3f54e65c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2bfabb779c7b416aaccd6c0afdba3918', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1e7d460e0a359405ebb66377d348be33dd3e41ad6affb29171aaa87af15cd4dd797d13b808a1e83fca4c0f3d9c48fe854bd976dae9647cc4cb914ae6621b3c8', 'id': '590a83bb-5cec-480d-834e-f539c8794c34', 'created_at': datetime.datetime(2026, 9, 30, 8, 40, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 40, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/590a83bb-5cec-480d-834e-f539c8794c34/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a5c062-4652-427c-aaa6-2548584afe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a5c062-4652-427c-aaa6-2548584afe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82599265-8cf7-4b41-8345-6ab5e09e0795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Volume 5d2e81ac-eb62-4828-9aa7-d3515da8a57b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b', 'volume_size': 1, 'image_id': '590a83bb-5cec-480d-834e-f539c8794c34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/590a83bb-5cec-480d-834e-f539c8794c34', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc95f3eedd5fc0f7f52484d3f54e65c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2bfabb779c7b416aaccd6c0afdba3918', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1e7d460e0a359405ebb66377d348be33dd3e41ad6affb29171aaa87af15cd4dd797d13b808a1e83fca4c0f3d9c48fe854bd976dae9647cc4cb914ae6621b3c8', 'id': '590a83bb-5cec-480d-834e-f539c8794c34', 'created_at': datetime.datetime(2026, 9, 30, 8, 40, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 40, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/590a83bb-5cec-480d-834e-f539c8794c34/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Trying to clone 5d2e81ac-eb62-4828-9aa7-d3515da8a57b from image 590a83bb-5cec-480d-834e-f539c8794c34 at location (None, [{'url': 'file:///opt/stack/data/glance/images/590a83bb-5cec-480d-834e-f539c8794c34', 'metadata': {}}]). {{(pid=87013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 10:40:32 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Image download 0.00 MB at 0.00 MB/s Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b9e6cf-f26f-48d3-a078-bc9beced3904]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:32 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD Sep 30 10:40:32 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (ef4128a2-3865-4800-8af8-a1d4bbadbb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac31e72-0f4c-4146-bcf6-88e5e36cc5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac31e72-0f4c-4146-bcf6-88e5e36cc5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-184420182',display_name='tempest-VolumesGetTest-Volume-1682665597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc036e9-beb2-4084-b31c-0fd57fa77508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:33Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914f5f8e-2f59-4a68-ac4e-faec30e172e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914f5f8e-2f59-4a68-ac4e-faec30e172e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c72e1c-b538-4473-9c0a-6a1806a26701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c72e1c-b538-4473-9c0a-6a1806a26701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc036e9-beb2-4084-b31c-0fd57fa77508', 'volume_name': 'volume-9dc036e9-beb2-4084-b31c-0fd57fa77508', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364cc451-16d5-4b74-b584-e6da18d626e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364cc451-16d5-4b74-b584-e6da18d626e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b240d05-f099-42be-9565-149a47258ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:33 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Volume 9dc036e9-beb2-4084-b31c-0fd57fa77508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc036e9-beb2-4084-b31c-0fd57fa77508', 'volume_size': 1} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-184420182',display_name='tempest-VolumesGetTest-Volume-1682665597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc036e9-beb2-4084-b31c-0fd57fa77508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:33Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Creating volume 9dc036e9-beb2-4084-b31c-0fd57fa77508 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:40:33 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:33 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:33 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508 1073741824 Sep 30 10:40:33 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:33 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD Sep 30 10:40:33 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:33 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Temporary image 590a83bb-5cec-480d-834e-f539c8794c34 is fetched for user 325e0ebd1e73475a919b5a37434781fa. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[359ae2bc-3cd8-43b6-95df-87e35718a42c]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:33 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508 1073741824" returned: 0 in 0.440s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:33 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508 Sep 30 10:40:33 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:33 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD Sep 30 10:40:33 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:33 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508" returned: 0 in 0.238s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b240d05-f099-42be-9565-149a47258ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc036e9-beb2-4084-b31c-0fd57fa77508', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c41146-14f7-4f0e-863b-357cc975affe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:33 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Volume volume-9dc036e9-beb2-4084-b31c-0fd57fa77508 (9dc036e9-beb2-4084-b31c-0fd57fa77508): created successfully Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c41146-14f7-4f0e-863b-357cc975affe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (ef4128a2-3865-4800-8af8-a1d4bbadbb3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:33 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:33 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-07fed552-9168-4917-aec2-618604bb7c31 tempest-VolumesGetTest-1184241256 None] Created volume successfully. Sep 30 10:40:33 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD Sep 30 10:40:33 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-9dc036e9-beb2-4084-b31c-0fd57fa77508-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Lock "cinder-9dc036e9-beb2-4084-b31c-0fd57fa77508-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:34 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2e81ac-eb62-4828-9aa7-d3515da8a57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bfabb779c7b416aaccd6c0afdba3918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:32Z,use_quota=True,user_id='325e0ebd1e73475a919b5a37434781fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(470e4a67-c33f-4096-a6f7-1688cd5ac0b3),volume_type_id=470e4a67-c33f-4096-a6f7-1688cd5ac0b3)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Creating volume 5d2e81ac-eb62-4828-9aa7-d3515da8a57b {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:40:34 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-quobyte-9dc036e9-beb2-4084-b31c-0fd57fa77508" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:34 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b 1073741824 Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-9dc036e9-beb2-4084-b31c-0fd57fa77508" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:34 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[464e9eb6-d04b-429b-8214-cddae23942ec]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:34 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508 Sep 30 10:40:34 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:34 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508" returned: 0 in 0.388s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:34 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b 1073741824" returned: 0 in 0.469s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:34 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508 Sep 30 10:40:34 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:34 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b Sep 30 10:40:34 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:34 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9dc036e9-beb2-4084-b31c-0fd57fa77508" returned: 0 in 0.244s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-9dc036e9-beb2-4084-b31c-0fd57fa77508" released by "delete_volume" :: held 0.687s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:34 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b" returned: 0 in 0.250s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Created reservations ['9207c494-a75a-4eee-a23d-f6e1f70056cb', '7caf2d99-bcc1-40dc-b75d-c4c4843fe085', '1557a889-ef85-4582-9d70-73ad61c75f76', '8495b168-7e44-4e0a-83c0-fc2f5c44b1c7'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:34 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Attempting download of 590a83bb-5cec-480d-834e-f539c8794c34 ((None, [{'url': 'file:///opt/stack/data/glance/images/590a83bb-5cec-480d-834e-f539c8794c34', 'metadata': {}}])) to volume 5d2e81ac-eb62-4828-9aa7-d3515da8a57b. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dd925d-b3ed-490e-b86f-2fdb3b4a4f87]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_590a83bb-5cec-480d-834e-f539c8794c34_a_wkktum {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:35 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:35 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:35 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_590a83bb-5cec-480d-834e-f539c8794c34_a_wkktum Sep 30 10:40:35 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:35 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.246s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Deleted volume successfully. Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-76d66697-0391-4754-b4f4-119f9378a0bc tempest-VolumesGetTest-1184241256 None] Lock "cinder-9dc036e9-beb2-4084-b31c-0fd57fa77508-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-0c03c17e-41c7-46cc-9459-fc2b0d87a9db-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Lock "cinder-0c03c17e-41c7-46cc-9459-fc2b0d87a9db-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:35 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_590a83bb-5cec-480d-834e-f539c8794c34_a_wkktum" returned: 0 in 0.396s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_590a83bb-5cec-480d-834e-f539c8794c34_a_wkktum {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-quobyte-0c03c17e-41c7-46cc-9459-fc2b0d87a9db" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-0c03c17e-41c7-46cc-9459-fc2b0d87a9db" acquired by "delete_volume" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81b2d5a-35ab-44ba-ad53-42ee6be4f6c3]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:35 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_590a83bb-5cec-480d-834e-f539c8794c34_a_wkktum Sep 30 10:40:35 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:35 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db Sep 30 10:40:35 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:35 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_590a83bb-5cec-480d-834e-f539c8794c34_a_wkktum" returned: 1 in 0.331s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_590a83bb-5cec-480d-834e-f539c8794c34_a_wkktum' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0578d2da-aee3-4a4a-ad9b-51ecc2e86c34]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:35 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD Sep 30 10:40:35 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:35 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db" returned: 0 in 0.365s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:35 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db Sep 30 10:40:35 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:36 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:36 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0c03c17e-41c7-46cc-9459-fc2b0d87a9db" returned: 0 in 0.256s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-0c03c17e-41c7-46cc-9459-fc2b0d87a9db" released by "delete_volume" :: held 0.667s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:36 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD Sep 30 10:40:36 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Created reservations ['66b1ddc5-5414-4f08-9e24-9bf1d161b599', 'f3eb678c-173d-4ce6-98cc-b47f0bfd88f2', '4a6db0ab-15d6-4937-bde1-dd8dfff32532', '82d5b740-6430-4aba-815b-e0681ea88015'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:36 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:36 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:36 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] 590a83bb-5cec-480d-834e-f539c8794c34 was raw, converting to qcow2 {{(pid=87013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:36 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b Sep 30 10:40:36 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:36 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.251s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:36 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Deleted volume successfully. Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9ddc174a-6c57-4646-92d7-636268c6369e tempest-VolumesGetTest-1184241256 None] Lock "cinder-0c03c17e-41c7-46cc-9459-fc2b0d87a9db-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-4f9ce04a-daa6-46ac-8e56-3fe0a207a631-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Lock "cinder-4f9ce04a-daa6-46ac-8e56-3fe0a207a631-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-quobyte-4f9ce04a-daa6-46ac-8e56-3fe0a207a631" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-4f9ce04a-daa6-46ac-8e56-3fe0a207a631" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3013e29-bb53-4246-946e-d7d4ce389438]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:36 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 Sep 30 10:40:36 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:36 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b" returned: 0 in 0.491s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_590a83bb-5cec-480d-834e-f539c8794c34_d5am9c5vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:40:36 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 10:40:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:36 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b 1G Sep 30 10:40:36 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:37 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:37 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:37 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631" returned: 0 in 0.406s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:37 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631 Sep 30 10:40:37 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:37 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b 1G" returned: 0 in 0.315s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Downloaded image 590a83bb-5cec-480d-834e-f539c8794c34 ((None, [{'url': 'file:///opt/stack/data/glance/images/590a83bb-5cec-480d-834e-f539c8794c34', 'metadata': {}}])) to volume 5d2e81ac-eb62-4828-9aa7-d3515da8a57b successfully. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Temporary image 590a83bb-5cec-480d-834e-f539c8794c34 for user 325e0ebd1e73475a919b5a37434781fa is deleted. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Marking volume 5d2e81ac-eb62-4828-9aa7-d3515da8a57b as bootable. {{(pid=87013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Copying metadata from image 590a83bb-5cec-480d-834e-f539c8794c34 to 5d2e81ac-eb62-4828-9aa7-d3515da8a57b. {{(pid=87013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Creating volume glance metadata for volume 5d2e81ac-eb62-4828-9aa7-d3515da8a57b backed by image 590a83bb-5cec-480d-834e-f539c8794c34 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '590a83bb-5cec-480d-834e-f539c8794c34', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fc95f3eedd5fc0f7f52484d3f54e65c5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 10:40:37 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.279s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82599265-8cf7-4b41-8345-6ab5e09e0795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b', 'volume_size': 1, 'image_id': '590a83bb-5cec-480d-834e-f539c8794c34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/590a83bb-5cec-480d-834e-f539c8794c34', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc95f3eedd5fc0f7f52484d3f54e65c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2bfabb779c7b416aaccd6c0afdba3918', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1e7d460e0a359405ebb66377d348be33dd3e41ad6affb29171aaa87af15cd4dd797d13b808a1e83fca4c0f3d9c48fe854bd976dae9647cc4cb914ae6621b3c8', 'id': '590a83bb-5cec-480d-834e-f539c8794c34', 'created_at': datetime.datetime(2026, 9, 30, 8, 40, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 40, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/590a83bb-5cec-480d-834e-f539c8794c34/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13384946-b755-4e9a-a6e6-523bde2aa66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:37 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Volume volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b (5d2e81ac-eb62-4828-9aa7-d3515da8a57b): created successfully Sep 30 10:40:37 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13384946-b755-4e9a-a6e6-523bde2aa66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Flow 'volume_create_manager' (1e40d33f-a79b-47ea-a746-2228133a6ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f9ce04a-daa6-46ac-8e56-3fe0a207a631" returned: 0 in 0.276s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-4f9ce04a-daa6-46ac-8e56-3fe0a207a631" released by "delete_volume" :: held 0.752s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:37 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-1a5e2213-af4b-47ee-89df-7aeb0e4862a5 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Created volume successfully. Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Created reservations ['eb5cb1ed-f581-4b82-a075-851bbf6bcc32', '86cabf80-2604-4ed3-97e8-6c2d17ade683', '47996517-d613-40b3-a146-0daf1e952c31', '0e60c56f-5225-4989-9c2f-6da683a0d991'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Acquiring lock "cinder-5d2e81ac-eb62-4828-9aa7-d3515da8a57b-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:37 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:37 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Lock "cinder-5d2e81ac-eb62-4828-9aa7-d3515da8a57b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Acquiring lock "cinder-quobyte-5d2e81ac-eb62-4828-9aa7-d3515da8a57b" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Lock "cinder-quobyte-5d2e81ac-eb62-4828-9aa7-d3515da8a57b" acquired by "delete_volume" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[70242215-14d2-46bc-979f-fdf50d02cae5]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:37 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b Sep 30 10:40:37 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:37 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.282s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:37 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Deleted volume successfully. Sep 30 10:40:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-66429cc9-e965-40a3-b372-e35ae6f7c7fd tempest-VolumesGetTest-1184241256 None] Lock "cinder-4f9ce04a-daa6-46ac-8e56-3fe0a207a631-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:38 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b" returned: 0 in 0.390s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:38 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b Sep 30 10:40:38 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:38 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5d2e81ac-eb62-4828-9aa7-d3515da8a57b" returned: 0 in 0.256s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Lock "cinder-quobyte-5d2e81ac-eb62-4828-9aa7-d3515da8a57b" released by "delete_volume" :: held 0.687s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:38 devstack cinder-volume[87013]: WARNING cinder.quota [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:40:38 devstack cinder-volume[87013]: WARNING cinder.quota [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Created reservations ['db0f040a-3083-4f72-80c8-c0228636670e', '9aa9470b-7e5a-413a-bdfd-431b39e86af2', 'baca556c-2076-41e7-bb98-6dbfcea88dee', '4f04f54c-3d4a-4b7d-8bc1-c1354aeeace7'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (897832b5-b859-409a-b088-c117c3f5e87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b2968d-da18-4656-8ffa-0ecb6b34bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b2968d-da18-4656-8ffa-0ecb6b34bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-578007190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d65d7e4-2432-447d-bfe5-b49edd883bc9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:38Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df67ef2-47bb-4b3f-8950-ebbceefa21c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df67ef2-47bb-4b3f-8950-ebbceefa21c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836af616-3532-4a29-920b-c5934e733380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.image.glance [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Creating Keystone auth plugin from conf {{(pid=87013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:38 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:38 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836af616-3532-4a29-920b-c5934e733380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d65d7e4-2432-447d-bfe5-b49edd883bc9', 'volume_name': 'volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b79b01-fd67-4327-b584-1b0f77f9a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b79b01-fd67-4327-b584-1b0f77f9a94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3e168d-4bf4-4e40-a3f9-ebc40d00315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:38 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Volume 0d65d7e4-2432-447d-bfe5-b49edd883bc9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Trying to clone 0d65d7e4-2432-447d-bfe5-b49edd883bc9 from image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]). {{(pid=87013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 10:40:38 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.274s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Deleted volume successfully. Sep 30 10:40:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a20f051c-eef6-44d1-8eef-54ff354d9134 tempest-VolumeAndVolumeTypeFromImageTest-731024800 None] Lock "cinder-5d2e81ac-eb62-4828-9aa7-d3515da8a57b-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 10:40:39 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Image download 20.69 MB at 20.69 MB/s Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4940644e-9894-449c-90c3-f31c2fdc8d7f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:39 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD Sep 30 10:40:39 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:39 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Temporary image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e is fetched for user fcd85027cfe84436a2ead3acc49ee530. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaec6023-7495-4b8a-a39a-baf3c0ab2662]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:39 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD Sep 30 10:40:39 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:39 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-578007190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d65d7e4-2432-447d-bfe5-b49edd883bc9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:38Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Creating volume 0d65d7e4-2432-447d-bfe5-b49edd883bc9 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:40:39 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:40:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:39 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 1073741824 Sep 30 10:40:40 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:40 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 1073741824" returned: 0 in 0.475s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:40 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 Sep 30 10:40:40 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:40 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9" returned: 0 in 0.278s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:40:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:40 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Attempting download of 0e96b9f2-4ae9-48ec-8d88-8e11a591034e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}])) to volume 0d65d7e4-2432-447d-bfe5-b49edd883bc9. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 10:40:40 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56439a9-8239-4d3f-8903-3cb7f1b44f5d]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_1arvstu5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:41 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_1arvstu5 Sep 30 10:40:41 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:41 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_1arvstu5" returned: 0 in 0.352s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_1arvstu5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:41 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_1arvstu5 Sep 30 10:40:41 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:41 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_1arvstu5" returned: 1 in 0.339s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_1arvstu5' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:40:41 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d010449-79e6-4d7f-9721-9336848e1d75]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:41 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD Sep 30 10:40:41 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:41 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:41 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] 0e96b9f2-4ae9-48ec-8d88-8e11a591034e was qcow2, converting to qcow2 {{(pid=87013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 10:40:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:41 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 Sep 30 10:40:41 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:43 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9" returned: 0 in 1.602s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e96b9f2-4ae9-48ec-8d88-8e11a591034e_x5k8mc_3devstack@QuobyteHD, size 112.00 MB, duration 1.60 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:40:43 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Converted 112.00 MB image at 69.86 MB/s Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:43 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 1G Sep 30 10:40:43 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:43 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 1G" returned: 0 in 0.320s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Downloaded image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}])) to volume 0d65d7e4-2432-447d-bfe5-b49edd883bc9 successfully. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Temporary image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e for user fcd85027cfe84436a2ead3acc49ee530 is deleted. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Marking volume 0d65d7e4-2432-447d-bfe5-b49edd883bc9 as bootable. {{(pid=87013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Copying metadata from image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e to 0d65d7e4-2432-447d-bfe5-b49edd883bc9. {{(pid=87013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Creating volume glance metadata for volume 0d65d7e4-2432-447d-bfe5-b49edd883bc9 backed by image 0e96b9f2-4ae9-48ec-8d88-8e11a591034e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3e168d-4bf4-4e40-a3f9-ebc40d00315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9', 'volume_size': 1, 'image_id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd496eec670d74b62a113ba09559087dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e96b9f2-4ae9-48ec-8d88-8e11a591034e', 'created_at': datetime.datetime(2026, 9, 30, 8, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 18, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e96b9f2-4ae9-48ec-8d88-8e11a591034e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8416d681-6bf4-4533-9f3a-56b36401df2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:43 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Volume volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 (0d65d7e4-2432-447d-bfe5-b49edd883bc9): created successfully Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8416d681-6bf4-4533-9f3a-56b36401df2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (897832b5-b859-409a-b088-c117c3f5e87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-1066ea57-07ec-4235-a5d7-76c3173a3ca0 tempest-VolumesGetTest-1184241256 None] Created volume successfully. Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (c36c6673-6f81-4098-b6cc-670b7fc995ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0118b3c1-6a09-4bda-b5f6-cc154c207bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0118b3c1-6a09-4bda-b5f6-cc154c207bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-299011238',display_name='tempest-VolumesGetTest-Volume-1164584290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f5565d-63fc-4b71-8bda-07761d44d866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:45Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00a0cba-5ac4-479f-9f68-433e06330c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00a0cba-5ac4-479f-9f68-433e06330c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d884cd-0e56-4a21-bdc6-78dbca63acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d884cd-0e56-4a21-bdc6-78dbca63acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f5565d-63fc-4b71-8bda-07761d44d866', 'volume_name': 'volume-11f5565d-63fc-4b71-8bda-07761d44d866', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa662e75-d012-466b-83fa-39584ac0c95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa662e75-d012-466b-83fa-39584ac0c95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a04d758-1754-496a-b975-8290322b8a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:45 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Volume 11f5565d-63fc-4b71-8bda-07761d44d866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f5565d-63fc-4b71-8bda-07761d44d866', 'volume_size': 1} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-299011238',display_name='tempest-VolumesGetTest-Volume-1164584290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f5565d-63fc-4b71-8bda-07761d44d866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867a6783c194700bccc32ee1fd5d92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:45Z,use_quota=True,user_id='fcd85027cfe84436a2ead3acc49ee530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Creating volume 11f5565d-63fc-4b71-8bda-07761d44d866 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:40:45 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:45 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866 1073741824 Sep 30 10:40:45 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:45 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866 1073741824" returned: 0 in 0.406s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:45 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866 Sep 30 10:40:45 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:46 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866" returned: 0 in 0.237s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a04d758-1754-496a-b975-8290322b8a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f5565d-63fc-4b71-8bda-07761d44d866', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9aca62-f2d6-417b-8cbf-c13dd39c81a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:46 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Volume volume-11f5565d-63fc-4b71-8bda-07761d44d866 (11f5565d-63fc-4b71-8bda-07761d44d866): created successfully Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9aca62-f2d6-417b-8cbf-c13dd39c81a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Flow 'volume_create_manager' (c36c6673-6f81-4098-b6cc-670b7fc995ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:46 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-81a7ceca-c2de-4c7f-b160-4b9825a90c8d tempest-VolumesGetTest-1184241256 None] Created volume successfully. Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-11f5565d-63fc-4b71-8bda-07761d44d866-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Lock "cinder-11f5565d-63fc-4b71-8bda-07761d44d866-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-quobyte-11f5565d-63fc-4b71-8bda-07761d44d866" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-11f5565d-63fc-4b71-8bda-07761d44d866" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e06e18-c742-4413-8cdf-bde144ab17ca]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:46 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866 Sep 30 10:40:46 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:46 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866" returned: 0 in 0.357s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:46 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866 Sep 30 10:40:46 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:47 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-11f5565d-63fc-4b71-8bda-07761d44d866" returned: 0 in 0.246s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-11f5565d-63fc-4b71-8bda-07761d44d866" released by "delete_volume" :: held 0.641s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Created reservations ['9cdbe91d-5dd2-4e37-963b-d519e92eb81e', '17130d27-f424-4eea-bad8-5efd0d969aee', '5851fe61-670e-4731-8e9e-9f16384a8a65', '9d53aaaa-059d-46c5-8986-f5188e0c87a7'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:47 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:47 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:47 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.241s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:47 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Deleted volume successfully. Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-05ced44a-61fa-428a-beaf-ec7864ec6427 tempest-VolumesGetTest-1184241256 None] Lock "cinder-11f5565d-63fc-4b71-8bda-07761d44d866-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-0d65d7e4-2432-447d-bfe5-b49edd883bc9-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Lock "cinder-0d65d7e4-2432-447d-bfe5-b49edd883bc9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Acquiring lock "cinder-quobyte-0d65d7e4-2432-447d-bfe5-b49edd883bc9" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-0d65d7e4-2432-447d-bfe5-b49edd883bc9" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cacfd4-9436-4e43-8ea6-7a81a6794075]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:47 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 Sep 30 10:40:47 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:48 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9" returned: 0 in 0.353s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:48 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9 Sep 30 10:40:48 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:48 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0d65d7e4-2432-447d-bfe5-b49edd883bc9" returned: 0 in 0.240s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Lock "cinder-quobyte-0d65d7e4-2432-447d-bfe5-b49edd883bc9" released by "delete_volume" :: held 0.632s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Created reservations ['0c5fa03b-768d-4937-b2c9-ca11d502721a', '2cda3030-f16c-49f7-bb05-e6120dac4d72', '441edcc6-6478-42b1-92ea-86bf72644c2e', '79857d13-b8c8-4e77-88d2-f05bb45f412b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:48 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:40:48 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:48 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.246s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:40:48 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Deleted volume successfully. Sep 30 10:40:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-306ada58-7f10-45c5-923c-f35214825da8 tempest-VolumesGetTest-1184241256 None] Lock "cinder-0d65d7e4-2432-447d-bfe5-b49edd883bc9-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Flow 'volume_create_manager' (002f01c9-b206-4f7c-a7b1-ce33a44a3ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae82e67-75b9-4f86-b0fc-31a470c69c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae82e67-75b9-4f86-b0fc-31a470c69c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2014669990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec3f913-e923-43f6-b190-9d4029bd9139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f62e13a9224207bb7d9e29439d5cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:52Z,use_quota=True,user_id='5658f284676c42a0b58d8aedac23b546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377e53ee-e384-4c9c-ad6f-811177cc8143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377e53ee-e384-4c9c-ad6f-811177cc8143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc08ac7f-bfd0-44b5-bd1c-43ff4f585360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc08ac7f-bfd0-44b5-bd1c-43ff4f585360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec3f913-e923-43f6-b190-9d4029bd9139', 'volume_name': 'volume-9ec3f913-e923-43f6-b190-9d4029bd9139', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2c9057-6149-4e6e-add9-01d70b180cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2c9057-6149-4e6e-add9-01d70b180cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c5aea3-6b84-49bb-b5d9-10b74306f839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:51 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Volume 9ec3f913-e923-43f6-b190-9d4029bd9139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec3f913-e923-43f6-b190-9d4029bd9139', 'volume_size': 1} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2014669990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec3f913-e923-43f6-b190-9d4029bd9139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f62e13a9224207bb7d9e29439d5cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:52Z,use_quota=True,user_id='5658f284676c42a0b58d8aedac23b546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Creating volume 9ec3f913-e923-43f6-b190-9d4029bd9139 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:40:51 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:40:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:51 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 1073741824 Sep 30 10:40:51 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:52 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 1073741824" returned: 0 in 0.408s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:52 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 Sep 30 10:40:52 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:52 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139" returned: 0 in 0.255s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:40:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c5aea3-6b84-49bb-b5d9-10b74306f839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec3f913-e923-43f6-b190-9d4029bd9139', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7668d3-ae78-40d5-acf7-d592baf48bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:52 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Volume volume-9ec3f913-e923-43f6-b190-9d4029bd9139 (9ec3f913-e923-43f6-b190-9d4029bd9139): created successfully Sep 30 10:40:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7668d3-ae78-40d5-acf7-d592baf48bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Flow 'volume_create_manager' (002f01c9-b206-4f7c-a7b1-ce33a44a3ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-62fe53ac-a4a8-4a5b-b758-b488c7534c9a tempest-VolumeDependencyTests-1799981678 None] Created volume successfully. Sep 30 10:40:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:53 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Creating offline snapshot 7d68dd44-f89b-4b32-b255-47dbf5902a6d of volume 9ec3f913-e923-43f6-b190-9d4029bd9139 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:40:53 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3726576f-a3ae-4cf4-9337-b8396930a49a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:53 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 Sep 30 10:40:53 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:53 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139" returned: 0 in 0.353s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:53 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d 1G Sep 30 10:40:53 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:53 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d 1G" returned: 0 in 0.394s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec3f913-e923-43f6-b190-9d4029bd9139 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:53 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec3f913-e923-43f6-b190-9d4029bd9139 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d Sep 30 10:40:53 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:54 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec3f913-e923-43f6-b190-9d4029bd9139 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d" returned: 0 in 0.286s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:54 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d is being set with open permissions: ugo+rw Sep 30 10:40:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:54 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d Sep 30 10:40:54 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:54 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d" returned: 0 in 0.237s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:54 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.info Sep 30 10:40:54 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:54 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.info" returned: 0 in 0.254s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:54 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.info is being set with open permissions: ugo+rw Sep 30 10:40:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:54 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.info Sep 30 10:40:54 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:54 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.info" returned: 0 in 0.243s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:54 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ada8695d-577e-4cc3-a9b1-2353fd4a4b8e tempest-VolumeDependencyTests-1799981678 None] Create snapshot completed successfully Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Flow 'volume_create_manager' (40dcdccf-cfc3-498e-9efa-3c3e1adcb03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d999e2-d886-4962-9102-90f15c4093e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d999e2-d886-4962-9102-90f15c4093e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1004174328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371bdd8b-526c-41be-8204-fbc54afebd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f62e13a9224207bb7d9e29439d5cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7d68dd44-f89b-4b32-b255-47dbf5902a6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:40:56Z,use_quota=True,user_id='5658f284676c42a0b58d8aedac23b546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0581bc92-22a6-4582-9970-904425211b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0581bc92-22a6-4582-9970-904425211b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5ef99c-56d6-4eb3-b0b5-26e2aa1409b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5ef99c-56d6-4eb3-b0b5-26e2aa1409b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '371bdd8b-526c-41be-8204-fbc54afebd93', 'volume_name': 'volume-371bdd8b-526c-41be-8204-fbc54afebd93', 'volume_size': 1, 'snapshot_id': '7d68dd44-f89b-4b32-b255-47dbf5902a6d'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a74eead-a2fb-4ff7-bf94-76f096696452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a74eead-a2fb-4ff7-bf94-76f096696452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bea5b6-d79e-4e40-ad7a-ffbbcdee74f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:40:55 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Volume 371bdd8b-526c-41be-8204-fbc54afebd93: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-371bdd8b-526c-41be-8204-fbc54afebd93', 'volume_size': 1, 'snapshot_id': '7d68dd44-f89b-4b32-b255-47dbf5902a6d'} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "cinder-quobyte-7d68dd44-f89b-4b32-b255-47dbf5902a6d-371bdd8b-526c-41be-8204-fbc54afebd93" by "_create_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-7d68dd44-f89b-4b32-b255-47dbf5902a6d-371bdd8b-526c-41be-8204-fbc54afebd93" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Creating volume 371bdd8b-526c-41be-8204-fbc54afebd93 from snapshot 7d68dd44-f89b-4b32-b255-47dbf5902a6d {{(pid=87013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "cinder-quobyte-371bdd8b-526c-41be-8204-fbc54afebd93" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-371bdd8b-526c-41be-8204-fbc54afebd93" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] snapshot: 7d68dd44-f89b-4b32-b255-47dbf5902a6d, volume: 371bdd8b-526c-41be-8204-fbc54afebd93, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[28569fb0-3d4c-4d2c-978f-010b70f2a0ce]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:55 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d Sep 30 10:40:55 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:56 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d" returned: 0 in 0.355s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ec3f913-e923-43f6-b190-9d4029bd9139(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:40:56 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1ebb02-7ce2-4c53-9af5-d63dd130831e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:40:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:56 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 Sep 30 10:40:56 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:40:56 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 30 10:40:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139" returned: 0 in 0.352s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:40:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:40:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:40:56 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:40:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:40:56 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 Sep 30 10:40:56 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:02 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93" returned: 0 in 5.849s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:41:02 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Converted 1024.00 MB image at 175.04 MB/s Sep 30 10:41:02 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 is being set with open permissions: ugo+rw Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:02 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 Sep 30 10:41:02 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:02 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93" returned: 0 in 0.242s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-371bdd8b-526c-41be-8204-fbc54afebd93" released by "_copy_volume_from_snapshot" :: held 6.882s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=106,cinder:UPDATE=128,cinder:INSERT=41,cinder:DELETE=12 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-7d68dd44-f89b-4b32-b255-47dbf5902a6d-371bdd8b-526c-41be-8204-fbc54afebd93" released by "_create_volume_from_snapshot" :: held 6.949s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.964s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bea5b6-d79e-4e40-ad7a-ffbbcdee74f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371bdd8b-526c-41be-8204-fbc54afebd93', 'volume_size': 1, 'snapshot_id': '7d68dd44-f89b-4b32-b255-47dbf5902a6d'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9a7f42-1a36-4996-81c6-445589f3ffb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:02 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Volume volume-371bdd8b-526c-41be-8204-fbc54afebd93 (371bdd8b-526c-41be-8204-fbc54afebd93): created successfully Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9a7f42-1a36-4996-81c6-445589f3ffb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:02 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Flow 'volume_create_manager' (40dcdccf-cfc3-498e-9efa-3c3e1adcb03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:02 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f69ac3eb-f691-4e04-af32-f0364023ac0e tempest-VolumeDependencyTests-1799981678 None] Created volume successfully. Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "cinder-7d68dd44-f89b-4b32-b255-47dbf5902a6d-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-7d68dd44-f89b-4b32-b255-47dbf5902a6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "cinder-quobyte-9ec3f913-e923-43f6-b190-9d4029bd9139" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-9ec3f913-e923-43f6-b190-9d4029bd9139" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "cinder-quobyte-7d68dd44-f89b-4b32-b255-47dbf5902a6d" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-7d68dd44-f89b-4b32-b255-47dbf5902a6d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Deleting offline snapshot 7d68dd44-f89b-4b32-b255-47dbf5902a6d of volume 9ec3f913-e923-43f6-b190-9d4029bd9139 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] snapshot_file for this snap is: volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a0b8c3-d8f6-47fe-9565-1b66e29c0608]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:03 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d Sep 30 10:41:03 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:03 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d" returned: 0 in 0.353s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ec3f913-e923-43f6-b190-9d4029bd9139(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fdc0bf-2fae-4547-b807-d98ee59fa387]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:03 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 Sep 30 10:41:03 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:04 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139" returned: 0 in 0.522s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:04 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d Sep 30 10:41:04 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:04 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d" returned: 0 in 0.320s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:04 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d Sep 30 10:41:04 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:04 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139.7d68dd44-f89b-4b32-b255-47dbf5902a6d" returned: 0 in 0.243s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-7d68dd44-f89b-4b32-b255-47dbf5902a6d" released by "_delete_snapshot" :: held 1.539s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-9ec3f913-e923-43f6-b190-9d4029bd9139" released by "delete_snapshot" :: held 1.561s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:04 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Created reservations ['be972fbb-5817-4c0e-8f0a-6bcd9c55abd9', 'a2b13f0b-ff67-4794-a3b5-3f00acfe0835', '9440b0c4-ad20-4526-9cd3-b92ed8e5ec35', '889ba2fd-1f92-4308-9dc6-4a8599735a88'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:41:04 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Delete snapshot completed successfully. Sep 30 10:41:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-837465e5-b12f-429f-8ddd-042881b0096e tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-7d68dd44-f89b-4b32-b255-47dbf5902a6d-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "cinder-9ec3f913-e923-43f6-b190-9d4029bd9139-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-9ec3f913-e923-43f6-b190-9d4029bd9139-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "cinder-quobyte-9ec3f913-e923-43f6-b190-9d4029bd9139" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-9ec3f913-e923-43f6-b190-9d4029bd9139" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1351124-6dac-4603-8fe7-fb072e06b5f3]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:05 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 Sep 30 10:41:05 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:05 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139" returned: 0 in 0.353s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:05 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139 Sep 30 10:41:05 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:06 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9ec3f913-e923-43f6-b190-9d4029bd9139" returned: 0 in 0.240s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-9ec3f913-e923-43f6-b190-9d4029bd9139" released by "delete_volume" :: held 0.652s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Created reservations ['016cea21-2c19-4ff9-9f28-577e4ca7bf2d', '9b17414e-2b4a-496a-a646-872a7a38235a', '4fb549f2-5014-465a-b99f-25ab0afee83d', '0425ee9d-5a11-4c25-a474-8c9addbd964c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:06 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:41:06 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:06 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.243s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:41:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Deleted volume successfully. Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-db449d82-5c3d-429d-9f37-810a4439dd0f tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-9ec3f913-e923-43f6-b190-9d4029bd9139-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "cinder-371bdd8b-526c-41be-8204-fbc54afebd93-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-371bdd8b-526c-41be-8204-fbc54afebd93-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "cinder-quobyte-371bdd8b-526c-41be-8204-fbc54afebd93" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-371bdd8b-526c-41be-8204-fbc54afebd93" acquired by "delete_volume" :: waited 0.013s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33946a4-3c0b-482e-8e59-a7c5e6d2874e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:06 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 Sep 30 10:41:06 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:06 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93" returned: 0 in 0.349s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:06 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93 Sep 30 10:41:06 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:07 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-371bdd8b-526c-41be-8204-fbc54afebd93" returned: 0 in 0.235s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-quobyte-371bdd8b-526c-41be-8204-fbc54afebd93" released by "delete_volume" :: held 0.624s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Created reservations ['427075fa-204d-4999-b0a2-2d8afedeb5fc', '85df0049-93c8-4998-9c3c-aba26a75d1a3', '56fc3335-97b5-46f6-9835-d6cffff9bac0', '2b4d51f1-86fa-405d-9b78-3dc79517ee9d'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:07 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:41:07 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:07 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.243s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:41:07 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Deleted volume successfully. Sep 30 10:41:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ed547c2f-1feb-403d-b75e-1c2afda85a01 tempest-VolumeDependencyTests-1799981678 None] Lock "cinder-371bdd8b-526c-41be-8204-fbc54afebd93-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Flow 'volume_create_manager' (785371c0-586b-40ae-a8f9-04de36ce072b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81de08e-25ed-4a7b-9b89-179e78d7c83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81de08e-25ed-4a7b-9b89-179e78d7c83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f1e880-9706-49e9-baca-f95e04762adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4cf869c1194960b85bfcf9a9816267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:10Z,use_quota=True,user_id='6c8f5dc4595e4412ae1870a97ca2ec69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59648823-dadb-43d0-945b-0b1266589429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59648823-dadb-43d0-945b-0b1266589429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccdfc5b-8a77-4958-82ce-416790574738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccdfc5b-8a77-4958-82ce-416790574738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f1e880-9706-49e9-baca-f95e04762adc', 'volume_name': 'volume-17f1e880-9706-49e9-baca-f95e04762adc', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9258d1ed-241a-482e-bf93-697e4d142f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9258d1ed-241a-482e-bf93-697e4d142f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e030b3-08f1-43e2-a883-c897be7dd8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:10 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Volume 17f1e880-9706-49e9-baca-f95e04762adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f1e880-9706-49e9-baca-f95e04762adc', 'volume_size': 1} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f1e880-9706-49e9-baca-f95e04762adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4cf869c1194960b85bfcf9a9816267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:10Z,use_quota=True,user_id='6c8f5dc4595e4412ae1870a97ca2ec69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Creating volume 17f1e880-9706-49e9-baca-f95e04762adc {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:41:10 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:10 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc 1073741824 Sep 30 10:41:10 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:10 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc 1073741824" returned: 0 in 0.408s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:10 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc Sep 30 10:41:10 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:11 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc" returned: 0 in 0.242s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e030b3-08f1-43e2-a883-c897be7dd8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f1e880-9706-49e9-baca-f95e04762adc', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bb52ee-25c8-4465-9270-d18aa362ab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:11 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Volume volume-17f1e880-9706-49e9-baca-f95e04762adc (17f1e880-9706-49e9-baca-f95e04762adc): created successfully Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bb52ee-25c8-4465-9270-d18aa362ab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Flow 'volume_create_manager' (785371c0-586b-40ae-a8f9-04de36ce072b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:11 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8c718627-15bc-4e35-84e5-889cb56da00b tempest-CinderUnicodeTest-1852713840 None] Created volume successfully. Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Flow 'volume_create_manager' (caa0603b-0376-4d2e-a954-6118d3d0824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb5f04f-4802-4204-978b-5dc485f2bd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb5f04f-4802-4204-978b-5dc485f2bd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-759050780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8014bc-cc20-4e97-ba20-3bfeed286465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4cf869c1194960b85bfcf9a9816267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:12Z,use_quota=True,user_id='6c8f5dc4595e4412ae1870a97ca2ec69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4bf05c-889f-4fe1-ab24-dc25d6db5d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4bf05c-889f-4fe1-ab24-dc25d6db5d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f66c4ba-f7bc-4066-9e57-77652d1c0806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f66c4ba-f7bc-4066-9e57-77652d1c0806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8014bc-cc20-4e97-ba20-3bfeed286465', 'volume_name': 'volume-2b8014bc-cc20-4e97-ba20-3bfeed286465', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb1fdb0-bf01-48d7-a092-116c1aa71592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb1fdb0-bf01-48d7-a092-116c1aa71592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83497370-2c27-4e85-a5cb-f46c68b853fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:11 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Volume 2b8014bc-cc20-4e97-ba20-3bfeed286465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8014bc-cc20-4e97-ba20-3bfeed286465', 'volume_size': 1} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-759050780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8014bc-cc20-4e97-ba20-3bfeed286465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4cf869c1194960b85bfcf9a9816267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:12Z,use_quota=True,user_id='6c8f5dc4595e4412ae1870a97ca2ec69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Creating volume 2b8014bc-cc20-4e97-ba20-3bfeed286465 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:41:11 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:41:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:11 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 1073741824 Sep 30 10:41:11 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:12 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 1073741824" returned: 0 in 0.404s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:12 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 Sep 30 10:41:12 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:12 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465" returned: 0 in 0.245s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:41:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83497370-2c27-4e85-a5cb-f46c68b853fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8014bc-cc20-4e97-ba20-3bfeed286465', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c9bfd0-b26a-4a9a-916d-7d1f032263ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:12 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Volume volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 (2b8014bc-cc20-4e97-ba20-3bfeed286465): created successfully Sep 30 10:41:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c9bfd0-b26a-4a9a-916d-7d1f032263ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Flow 'volume_create_manager' (caa0603b-0376-4d2e-a954-6118d3d0824b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-6cee4129-1119-4fba-8a29-e378e0924bd7 tempest-CinderUnicodeTest-1852713840 None] Created volume successfully. Sep 30 10:41:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Creating offline snapshot 503913d9-1362-4921-8eef-7680466d3be1 of volume 2b8014bc-cc20-4e97-ba20-3bfeed286465 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:41:13 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6292ffc0-fb08-4464-8f8e-326173dd5f15]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:13 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 Sep 30 10:41:13 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:13 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465" returned: 0 in 0.348s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:13 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 1G Sep 30 10:41:13 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:13 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 1G" returned: 0 in 0.390s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:13 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 Sep 30 10:41:13 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:14 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1" returned: 0 in 0.282s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:14 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 is being set with open permissions: ugo+rw Sep 30 10:41:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:14 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 Sep 30 10:41:14 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:14 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1" returned: 0 in 0.232s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:14 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.info Sep 30 10:41:14 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:14 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.info" returned: 0 in 0.260s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:14 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.info is being set with open permissions: ugo+rw Sep 30 10:41:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:14 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.info Sep 30 10:41:14 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:14 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.info" returned: 0 in 0.233s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:14 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fbf41460-a78c-469f-819e-076e732449c1 tempest-CinderUnicodeTest-1852713840 None] Create snapshot completed successfully Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "cinder-503913d9-1362-4921-8eef-7680466d3be1-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-503913d9-1362-4921-8eef-7680466d3be1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "cinder-quobyte-2b8014bc-cc20-4e97-ba20-3bfeed286465" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-quobyte-2b8014bc-cc20-4e97-ba20-3bfeed286465" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "cinder-quobyte-503913d9-1362-4921-8eef-7680466d3be1" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-quobyte-503913d9-1362-4921-8eef-7680466d3be1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Deleting offline snapshot 503913d9-1362-4921-8eef-7680466d3be1 of volume 2b8014bc-cc20-4e97-ba20-3bfeed286465 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] snapshot_file for this snap is: volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd4697d-12ba-4fa5-a78b-abe666bbd02c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:15 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 Sep 30 10:41:15 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:15 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1" returned: 0 in 0.356s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b8014bc-cc20-4e97-ba20-3bfeed286465(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d2abc3-ff32-4797-8ae8-6ccfc3b43ee9]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:15 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 Sep 30 10:41:15 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:15 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465" returned: 0 in 0.348s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:16 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 Sep 30 10:41:16 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:16 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1" returned: 0 in 0.326s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:16 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1 Sep 30 10:41:16 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:16 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465.503913d9-1362-4921-8eef-7680466d3be1" returned: 0 in 0.255s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-quobyte-503913d9-1362-4921-8eef-7680466d3be1" released by "_delete_snapshot" :: held 1.395s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-quobyte-2b8014bc-cc20-4e97-ba20-3bfeed286465" released by "delete_snapshot" :: held 1.416s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:16 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Created reservations ['478fee45-42cd-4e4a-8e01-318c1481939b', 'a791ebae-a549-468e-a0fe-e4ba65a17d55', 'c14d7051-3a84-4251-95a6-ad18efcc6414', '0e8338ad-b894-4688-aaa4-608a69012c8c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:41:16 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Delete snapshot completed successfully. Sep 30 10:41:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a223f380-8eee-411e-9578-38217fe30ea5 tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-503913d9-1362-4921-8eef-7680466d3be1-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "cinder-2b8014bc-cc20-4e97-ba20-3bfeed286465-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-2b8014bc-cc20-4e97-ba20-3bfeed286465-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "cinder-quobyte-2b8014bc-cc20-4e97-ba20-3bfeed286465" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-quobyte-2b8014bc-cc20-4e97-ba20-3bfeed286465" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:17 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4817c9-7710-4071-955d-00e315708250]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:17 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 Sep 30 10:41:17 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:17 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465" returned: 0 in 0.363s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:17 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465 Sep 30 10:41:17 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:18 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-2b8014bc-cc20-4e97-ba20-3bfeed286465" returned: 0 in 0.252s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-quobyte-2b8014bc-cc20-4e97-ba20-3bfeed286465" released by "delete_volume" :: held 0.677s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Created reservations ['f77157af-deb0-405d-83f7-6c2fea567569', 'd3d9676e-ebf4-488e-862e-0af834a74c16', '34b1169c-978f-4fad-bf43-77be953539e9', '026ccbf0-ff6f-414a-9fd3-5eafa67df8b5'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:18 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:41:18 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:18 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.251s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:41:18 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Deleted volume successfully. Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ceeb847a-8d29-4826-8edc-a21ea229fedc tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-2b8014bc-cc20-4e97-ba20-3bfeed286465-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "cinder-17f1e880-9706-49e9-baca-f95e04762adc-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-17f1e880-9706-49e9-baca-f95e04762adc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "cinder-quobyte-17f1e880-9706-49e9-baca-f95e04762adc" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-quobyte-17f1e880-9706-49e9-baca-f95e04762adc" acquired by "delete_volume" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e44c28-befc-456e-a5e2-014f3839c452]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:18 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc Sep 30 10:41:18 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:18 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc" returned: 0 in 0.359s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:18 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc Sep 30 10:41:18 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:19 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-17f1e880-9706-49e9-baca-f95e04762adc" returned: 0 in 0.264s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-quobyte-17f1e880-9706-49e9-baca-f95e04762adc" released by "delete_volume" :: held 0.667s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Created reservations ['7adca4a0-fbd8-4ce9-898f-7098641e2ac4', '8132202e-2ae8-4eb2-8c92-cc9e74984dd0', 'fb03adf0-3961-43e9-b1bd-f64a6651d960', '3db52ee9-3edb-4cfd-97b1-c41a9afa50d2'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:19 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:41:19 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:19 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.254s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:41:19 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Deleted volume successfully. Sep 30 10:41:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d8437fed-d6ea-49a5-a4ce-85986e27e5d6 tempest-CinderUnicodeTest-1852713840 None] Lock "cinder-17f1e880-9706-49e9-baca-f95e04762adc-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:26 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:41:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Flow 'volume_create_manager' (e802dff8-6086-4d68-ac7d-7f67f3abbddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4cf4e67-a082-432c-91a8-c1cdf921a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4cf4e67-a082-432c-91a8-c1cdf921a414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2139190418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5ee1e4-0619-4126-9328-493396cfefdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a3c0c34b7b4ba086f1e3b0cab40e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:27Z,use_quota=True,user_id='8bd9661002b647f5aaf349f7ee1fda78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5930ae-5b7a-4536-96d1-a61d02be8b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5930ae-5b7a-4536-96d1-a61d02be8b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd40e0e-5e2c-48fe-b6d5-a2e00b48d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd40e0e-5e2c-48fe-b6d5-a2e00b48d446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5ee1e4-0619-4126-9328-493396cfefdb', 'volume_name': 'volume-7a5ee1e4-0619-4126-9328-493396cfefdb', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60984b0-c58f-4f12-8a43-f74679b049c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60984b0-c58f-4f12-8a43-f74679b049c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cb6976-3750-44a2-9966-8c410d82b40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:27 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Volume 7a5ee1e4-0619-4126-9328-493396cfefdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5ee1e4-0619-4126-9328-493396cfefdb', 'volume_size': 1} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2139190418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5ee1e4-0619-4126-9328-493396cfefdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a3c0c34b7b4ba086f1e3b0cab40e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:27Z,use_quota=True,user_id='8bd9661002b647f5aaf349f7ee1fda78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Creating volume 7a5ee1e4-0619-4126-9328-493396cfefdb {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:41:27 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:27 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb 1073741824 Sep 30 10:41:27 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:27 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb 1073741824" returned: 0 in 0.414s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:27 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb Sep 30 10:41:27 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:27 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb" returned: 0 in 0.244s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cb6976-3750-44a2-9966-8c410d82b40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5ee1e4-0619-4126-9328-493396cfefdb', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d969dc-afd1-48dd-8e6f-33d17385a734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:27 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Volume volume-7a5ee1e4-0619-4126-9328-493396cfefdb (7a5ee1e4-0619-4126-9328-493396cfefdb): created successfully Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d969dc-afd1-48dd-8e6f-33d17385a734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:27 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Flow 'volume_create_manager' (e802dff8-6086-4d68-ac7d-7f67f3abbddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:27 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-97726698-2729-4732-8af3-c36eb8b00ef9 tempest-ProjectReaderTests-1011501348 None] Created volume successfully. Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Acquiring lock "cinder-7a5ee1e4-0619-4126-9328-493396cfefdb-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Lock "cinder-7a5ee1e4-0619-4126-9328-493396cfefdb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Acquiring lock "cinder-quobyte-7a5ee1e4-0619-4126-9328-493396cfefdb" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Lock "cinder-quobyte-7a5ee1e4-0619-4126-9328-493396cfefdb" acquired by "delete_volume" :: waited 0.013s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba676645-bfe4-4625-a6f1-7d74dd39c19c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:28 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb Sep 30 10:41:28 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:28 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb" returned: 0 in 0.371s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:28 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb Sep 30 10:41:28 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:28 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7a5ee1e4-0619-4126-9328-493396cfefdb" returned: 0 in 0.241s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Lock "cinder-quobyte-7a5ee1e4-0619-4126-9328-493396cfefdb" released by "delete_volume" :: held 0.653s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Created reservations ['a1467877-4b00-455d-8e77-2b25d2769ed1', '873e8ad6-55b3-4b3d-a9f6-f3871e67e164', '64c6be20-202a-417a-984e-8ff52e395424', '28b61daa-4acc-4ce0-ba1b-f60e2a361b7d'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:28 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:41:28 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:29 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.238s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:41:29 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Deleted volume successfully. Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89cb2f90-c80d-4e60-a69c-8a0e13457a2a tempest-ProjectReaderTests-1011501348 None] Lock "cinder-7a5ee1e4-0619-4126-9328-493396cfefdb-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Flow 'volume_create_manager' (4a81bbca-aaaf-489e-b076-84323fee0678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1473a2-bb40-4e9a-8c8b-fade6991b476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1473a2-bb40-4e9a-8c8b-fade6991b476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-116194738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70632bab-d63c-4a4f-8597-29d3c79ce804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a3c0c34b7b4ba086f1e3b0cab40e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:30Z,use_quota=True,user_id='8bd9661002b647f5aaf349f7ee1fda78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd1049c-7311-426d-bce5-30442ff5f176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd1049c-7311-426d-bce5-30442ff5f176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12e05b4-841d-4724-947d-0c0fc58a36a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12e05b4-841d-4724-947d-0c0fc58a36a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70632bab-d63c-4a4f-8597-29d3c79ce804', 'volume_name': 'volume-70632bab-d63c-4a4f-8597-29d3c79ce804', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468ab95e-0115-40af-870e-eac9263e3465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468ab95e-0115-40af-870e-eac9263e3465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc923108-f90d-4e18-bf62-6c1016ac2511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:29 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Volume 70632bab-d63c-4a4f-8597-29d3c79ce804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70632bab-d63c-4a4f-8597-29d3c79ce804', 'volume_size': 1} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-116194738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70632bab-d63c-4a4f-8597-29d3c79ce804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a3c0c34b7b4ba086f1e3b0cab40e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:30Z,use_quota=True,user_id='8bd9661002b647f5aaf349f7ee1fda78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Creating volume 70632bab-d63c-4a4f-8597-29d3c79ce804 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:41:29 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:41:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:29 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804 1073741824 Sep 30 10:41:29 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:30 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804 1073741824" returned: 0 in 0.413s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:30 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804 Sep 30 10:41:30 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:30 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804" returned: 0 in 0.257s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc923108-f90d-4e18-bf62-6c1016ac2511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70632bab-d63c-4a4f-8597-29d3c79ce804', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0d5c6a-d16a-4973-bf17-f9f9cfb8d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:30 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Volume volume-70632bab-d63c-4a4f-8597-29d3c79ce804 (70632bab-d63c-4a4f-8597-29d3c79ce804): created successfully Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0d5c6a-d16a-4973-bf17-f9f9cfb8d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Flow 'volume_create_manager' (4a81bbca-aaaf-489e-b076-84323fee0678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-537b7868-a567-400f-9eab-2bb4b4e0f5f5 tempest-ProjectReaderTests-1011501348 None] Created volume successfully. Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Acquiring lock "cinder-70632bab-d63c-4a4f-8597-29d3c79ce804-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Lock "cinder-70632bab-d63c-4a4f-8597-29d3c79ce804-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Acquiring lock "cinder-quobyte-70632bab-d63c-4a4f-8597-29d3c79ce804" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Lock "cinder-quobyte-70632bab-d63c-4a4f-8597-29d3c79ce804" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb4231b-c97e-4322-acee-b7e51d994231]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:30 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804 Sep 30 10:41:30 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:31 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804" returned: 0 in 0.366s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:31 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804 Sep 30 10:41:31 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:31 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-70632bab-d63c-4a4f-8597-29d3c79ce804" returned: 0 in 0.241s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Lock "cinder-quobyte-70632bab-d63c-4a4f-8597-29d3c79ce804" released by "delete_volume" :: held 0.649s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=140,cinder:DELETE=12,cinder:SELECT=106,cinder:INSERT=42 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Created reservations ['a6f5ae8c-efcd-4a4b-b8bd-a1ffa04d7e85', 'c87f44f3-be38-4ee3-8201-b8726f68ccde', 'b8c80fd9-5212-439a-befd-3cdfbe158147', '32b33f55-7813-4414-9841-5a882c7b755e'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:31 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:41:31 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:31 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.243s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:41:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Deleted volume successfully. Sep 30 10:41:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f1279db0-e86b-442b-a0c3-6b25e1bb314d tempest-ProjectReaderTests-1011501348 None] Lock "cinder-70632bab-d63c-4a4f-8597-29d3c79ce804-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Flow 'volume_create_manager' (bd5b7943-7616-42bf-b1da-5342514bbd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a2a67c-02eb-47b9-96e4-7271510eb9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a2a67c-02eb-47b9-96e4-7271510eb9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1606116594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72043115-96f2-41e6-a48d-c48741566b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a3c0c34b7b4ba086f1e3b0cab40e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:32Z,use_quota=True,user_id='8bd9661002b647f5aaf349f7ee1fda78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40579ed1-aaad-4ea7-9b9d-3dda43c8670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40579ed1-aaad-4ea7-9b9d-3dda43c8670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49741b8c-904c-467c-8cda-7a2a82a8543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49741b8c-904c-467c-8cda-7a2a82a8543c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72043115-96f2-41e6-a48d-c48741566b45', 'volume_name': 'volume-72043115-96f2-41e6-a48d-c48741566b45', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4990c352-b2ce-4e67-a863-4241727c376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4990c352-b2ce-4e67-a863-4241727c376f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe426ce6-5c29-4f41-a05f-5ee06d4509d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:32 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Volume 72043115-96f2-41e6-a48d-c48741566b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72043115-96f2-41e6-a48d-c48741566b45', 'volume_size': 1} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1606116594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72043115-96f2-41e6-a48d-c48741566b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a3c0c34b7b4ba086f1e3b0cab40e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:32Z,use_quota=True,user_id='8bd9661002b647f5aaf349f7ee1fda78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Creating volume 72043115-96f2-41e6-a48d-c48741566b45 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:41:32 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:32 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45 1073741824 Sep 30 10:41:32 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:32 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45 1073741824" returned: 0 in 0.416s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:32 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45 Sep 30 10:41:32 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:33 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45" returned: 0 in 0.243s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe426ce6-5c29-4f41-a05f-5ee06d4509d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72043115-96f2-41e6-a48d-c48741566b45', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688680cc-5fb2-4861-8bad-780de0cfb363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:33 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Volume volume-72043115-96f2-41e6-a48d-c48741566b45 (72043115-96f2-41e6-a48d-c48741566b45): created successfully Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688680cc-5fb2-4861-8bad-780de0cfb363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Flow 'volume_create_manager' (bd5b7943-7616-42bf-b1da-5342514bbd72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:33 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-24caacef-deb6-4ead-9266-9a61c3fd31d1 tempest-ProjectReaderTests-1011501348 None] Created volume successfully. Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Acquiring lock "cinder-72043115-96f2-41e6-a48d-c48741566b45-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Lock "cinder-72043115-96f2-41e6-a48d-c48741566b45-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Acquiring lock "cinder-quobyte-72043115-96f2-41e6-a48d-c48741566b45" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Lock "cinder-quobyte-72043115-96f2-41e6-a48d-c48741566b45" acquired by "delete_volume" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da4001-e86f-49a3-86f5-c2cb00fd9a36]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:33 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45 Sep 30 10:41:33 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:34 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45" returned: 0 in 0.377s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:34 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45 Sep 30 10:41:34 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:34 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-72043115-96f2-41e6-a48d-c48741566b45" returned: 0 in 0.252s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Lock "cinder-quobyte-72043115-96f2-41e6-a48d-c48741566b45" released by "delete_volume" :: held 0.675s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Created reservations ['172fb185-6593-48c1-a3c5-7748ef16d176', 'afa82439-4137-4d88-8832-b91b6d196bf5', 'eb06962f-0f02-4271-a9a2-0ce523ed6d5e', 'fa5a2b2e-ac12-4dc4-9c90-cf031ef4af4d'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:34 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:41:34 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:34 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.261s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:41:34 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Deleted volume successfully. Sep 30 10:41:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-44123d79-c3b5-4051-9c25-595cad745c2a tempest-ProjectReaderTests-1011501348 None] Lock "cinder-72043115-96f2-41e6-a48d-c48741566b45-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Flow 'volume_create_manager' (c08162e6-1ae1-4d92-b5a1-d09fb8242005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9442e62d-d2fe-4494-891f-520380cf1a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9442e62d-d2fe-4494-891f-520380cf1a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285472294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7934b0f9-c225-4839-bfde-68a92d201cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a3c0c34b7b4ba086f1e3b0cab40e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:35Z,use_quota=True,user_id='8bd9661002b647f5aaf349f7ee1fda78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b4cdbc-ea24-4caa-857c-5dcb65eb15d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b4cdbc-ea24-4caa-857c-5dcb65eb15d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd7ba90-3fe1-4122-ad4e-02bda7f04725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd7ba90-3fe1-4122-ad4e-02bda7f04725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7934b0f9-c225-4839-bfde-68a92d201cc5', 'volume_name': 'volume-7934b0f9-c225-4839-bfde-68a92d201cc5', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3894aaeb-3b7b-4403-b2d0-528a26bff877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3894aaeb-3b7b-4403-b2d0-528a26bff877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4444e73-d030-4ee4-a49c-6196fe7fefdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:35 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Volume 7934b0f9-c225-4839-bfde-68a92d201cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7934b0f9-c225-4839-bfde-68a92d201cc5', 'volume_size': 1} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285472294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7934b0f9-c225-4839-bfde-68a92d201cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a3c0c34b7b4ba086f1e3b0cab40e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:41:35Z,use_quota=True,user_id='8bd9661002b647f5aaf349f7ee1fda78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Creating volume 7934b0f9-c225-4839-bfde-68a92d201cc5 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:41:35 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:35 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5 1073741824 Sep 30 10:41:35 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:35 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5 1073741824" returned: 0 in 0.426s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:35 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5 Sep 30 10:41:35 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:36 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5" returned: 0 in 0.248s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4444e73-d030-4ee4-a49c-6196fe7fefdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7934b0f9-c225-4839-bfde-68a92d201cc5', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c9746b-69c5-4804-bb2a-16360acf1213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:41:36 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Volume volume-7934b0f9-c225-4839-bfde-68a92d201cc5 (7934b0f9-c225-4839-bfde-68a92d201cc5): created successfully Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c9746b-69c5-4804-bb2a-16360acf1213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Flow 'volume_create_manager' (c08162e6-1ae1-4d92-b5a1-d09fb8242005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:41:36 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9ebec121-03d7-46e1-9d50-90f16d419ffb tempest-ProjectReaderTests-1011501348 None] Created volume successfully. Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Acquiring lock "cinder-7934b0f9-c225-4839-bfde-68a92d201cc5-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Lock "cinder-7934b0f9-c225-4839-bfde-68a92d201cc5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Acquiring lock "cinder-quobyte-7934b0f9-c225-4839-bfde-68a92d201cc5" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Lock "cinder-quobyte-7934b0f9-c225-4839-bfde-68a92d201cc5" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e4c164-cf2e-4164-852f-8c07f13a327e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:36 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5 Sep 30 10:41:36 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:36 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5" returned: 0 in 0.380s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:36 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5 Sep 30 10:41:36 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:36 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7934b0f9-c225-4839-bfde-68a92d201cc5" returned: 0 in 0.255s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Lock "cinder-quobyte-7934b0f9-c225-4839-bfde-68a92d201cc5" released by "delete_volume" :: held 0.679s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:37 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:41:37 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Created reservations ['2719a5a0-524b-485e-aa2a-3223255ef69b', '414c85c8-dfb7-444e-88a0-3daf58e7e589', '9195b2cf-3e20-4f4a-b79c-79220bb0b343', '03084e87-0c62-4ce0-88b7-da8021c3636c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:41:37 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:41:37 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:41:37 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.246s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:41:37 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.269s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:41:37 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Deleted volume successfully. Sep 30 10:41:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-218e1605-ce41-43a7-9e26-c82cc56ae9b8 tempest-ProjectReaderTests-1011501348 None] Lock "cinder-7934b0f9-c225-4839-bfde-68a92d201cc5-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:41:47 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:INSERT=8,cinder:UPDATE=28,cinder:SELECT=18,cinder:DELETE=2 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:41:47 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=92,cinder:DELETE=9,cinder:SELECT=67,cinder:INSERT=25 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:42:00 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Flow 'volume_create_manager' (ec1eabb0-0d7a-4fde-986f-2baf8e0d2df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120dc4bc-320a-4f24-9966-fca3d9362900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120dc4bc-320a-4f24-9966-fca3d9362900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-164736149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fa49ec-742d-4773-bc42-5095dfe88216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0260f172ee149d89bb380fbfea67fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:01Z,use_quota=True,user_id='b70237722ca34aa6ad44ccea01ad78da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1557bb26-cff2-4353-a91c-b5687e3acacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1557bb26-cff2-4353-a91c-b5687e3acacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7b446e-9ee0-46c8-b3e4-a54421a913d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7b446e-9ee0-46c8-b3e4-a54421a913d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88fa49ec-742d-4773-bc42-5095dfe88216', 'volume_name': 'volume-88fa49ec-742d-4773-bc42-5095dfe88216', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e638ce98-6fe9-4539-8eac-0a49923e0ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e638ce98-6fe9-4539-8eac-0a49923e0ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea7832c-11b4-4c31-8c0b-98873dd16944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:01 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Volume 88fa49ec-742d-4773-bc42-5095dfe88216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88fa49ec-742d-4773-bc42-5095dfe88216', 'volume_size': 1} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-164736149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fa49ec-742d-4773-bc42-5095dfe88216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0260f172ee149d89bb380fbfea67fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:01Z,use_quota=True,user_id='b70237722ca34aa6ad44ccea01ad78da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Creating volume 88fa49ec-742d-4773-bc42-5095dfe88216 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:01 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:01 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 1073741824 Sep 30 10:42:01 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:01 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 1073741824" returned: 0 in 0.419s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:01 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 Sep 30 10:42:01 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:01 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216" returned: 0 in 0.244s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea7832c-11b4-4c31-8c0b-98873dd16944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88fa49ec-742d-4773-bc42-5095dfe88216', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9f5d6a-cc25-45cc-9af0-6194b8785f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:01 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Volume volume-88fa49ec-742d-4773-bc42-5095dfe88216 (88fa49ec-742d-4773-bc42-5095dfe88216): created successfully Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9f5d6a-cc25-45cc-9af0-6194b8785f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:01 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Flow 'volume_create_manager' (ec1eabb0-0d7a-4fde-986f-2baf8e0d2df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:01 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-32433a2f-af0e-4c59-83c9-fec413a149f3 tempest-SnapshotDependencyTests-467467614 None] Created volume successfully. Sep 30 10:42:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Creating offline snapshot cb5ee2c9-e697-466b-9e3b-5cf4145543a0 of volume 88fa49ec-742d-4773-bc42-5095dfe88216 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:42:02 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[03138714-f8d9-41e6-9d13-32eaabf18e77]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:02 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 Sep 30 10:42:02 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:02 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216" returned: 0 in 0.353s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:02 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 1G Sep 30 10:42:02 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:02 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 1G" returned: 0 in 0.382s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88fa49ec-742d-4773-bc42-5095dfe88216 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:02 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88fa49ec-742d-4773-bc42-5095dfe88216 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 Sep 30 10:42:02 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:03 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88fa49ec-742d-4773-bc42-5095dfe88216 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0" returned: 0 in 0.285s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:03 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 is being set with open permissions: ugo+rw Sep 30 10:42:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:03 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 Sep 30 10:42:03 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:03 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0" returned: 0 in 0.231s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:03 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.info Sep 30 10:42:03 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:03 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.info" returned: 0 in 0.239s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:03 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.info is being set with open permissions: ugo+rw Sep 30 10:42:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:03 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.info Sep 30 10:42:03 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:03 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.info" returned: 0 in 0.240s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:04 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f7766b0f-edb0-42a8-bab0-c1cba515bdcf tempest-SnapshotDependencyTests-467467614 None] Create snapshot completed successfully Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Flow 'volume_create_manager' (99d328c4-00ec-4e95-bd5e-b11937955050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d58c77a-7957-4615-8f40-d86e3c801f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d58c77a-7957-4615-8f40-d86e3c801f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0260f172ee149d89bb380fbfea67fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cb5ee2c9-e697-466b-9e3b-5cf4145543a0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:05Z,use_quota=True,user_id='b70237722ca34aa6ad44ccea01ad78da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848ff78a-555a-4bdc-9f98-2e4eac65e365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848ff78a-555a-4bdc-9f98-2e4eac65e365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f649b5f-2068-424b-a88f-e573d60aa246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f649b5f-2068-424b-a88f-e573d60aa246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77', 'volume_name': 'volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77', 'volume_size': 1, 'snapshot_id': 'cb5ee2c9-e697-466b-9e3b-5cf4145543a0'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf9db03-cf8e-4e7f-bebb-db8345b92b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf9db03-cf8e-4e7f-bebb-db8345b92b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4524805-134b-4a98-a6c3-da37b51113d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:04 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Volume 3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77', 'volume_size': 1, 'snapshot_id': 'cb5ee2c9-e697-466b-9e3b-5cf4145543a0'} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "cinder-quobyte-cb5ee2c9-e697-466b-9e3b-5cf4145543a0-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" by "_create_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-cb5ee2c9-e697-466b-9e3b-5cf4145543a0-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Creating volume 3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 from snapshot cb5ee2c9-e697-466b-9e3b-5cf4145543a0 {{(pid=87013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "cinder-quobyte-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] snapshot: cb5ee2c9-e697-466b-9e3b-5cf4145543a0, volume: 3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2611d8ef-a7a3-46cb-a8d1-e01cb6550be2]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:05 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 Sep 30 10:42:05 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:05 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0" returned: 0 in 0.345s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88fa49ec-742d-4773-bc42-5095dfe88216(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:42:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe08d489-cffb-4b04-98a3-e57431059488]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:05 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 Sep 30 10:42:05 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:05 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216" returned: 0 in 0.358s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:42:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:42:05 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:42:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:05 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 Sep 30 10:42:05 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:11 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" returned: 0 in 5.781s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:42:11 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Converted 1024.00 MB image at 177.10 MB/s Sep 30 10:42:11 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 is being set with open permissions: ugo+rw Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:11 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 Sep 30 10:42:11 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:11 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" returned: 0 in 0.235s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" released by "_copy_volume_from_snapshot" :: held 6.796s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-cb5ee2c9-e697-466b-9e3b-5cf4145543a0-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" released by "_create_volume_from_snapshot" :: held 6.860s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.874s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4524805-134b-4a98-a6c3-da37b51113d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77', 'volume_size': 1, 'snapshot_id': 'cb5ee2c9-e697-466b-9e3b-5cf4145543a0'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514ee0d7-8e60-479b-9e65-e191a1d92e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:11 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Volume volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 (3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77): created successfully Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514ee0d7-8e60-479b-9e65-e191a1d92e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:11 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Flow 'volume_create_manager' (99d328c4-00ec-4e95-bd5e-b11937955050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:11 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d3c82add-7e74-4825-9e13-6bf845a7be84 tempest-SnapshotDependencyTests-467467614 None] Created volume successfully. Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "cinder-cb5ee2c9-e697-466b-9e3b-5cf4145543a0-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-cb5ee2c9-e697-466b-9e3b-5cf4145543a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "cinder-quobyte-88fa49ec-742d-4773-bc42-5095dfe88216" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-88fa49ec-742d-4773-bc42-5095dfe88216" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "cinder-quobyte-cb5ee2c9-e697-466b-9e3b-5cf4145543a0" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-cb5ee2c9-e697-466b-9e3b-5cf4145543a0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Deleting offline snapshot cb5ee2c9-e697-466b-9e3b-5cf4145543a0 of volume 88fa49ec-742d-4773-bc42-5095dfe88216 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] snapshot_file for this snap is: volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[884a6505-e48e-424f-b41b-79d2138678c1]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:12 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 Sep 30 10:42:12 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:12 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0" returned: 0 in 0.342s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88fa49ec-742d-4773-bc42-5095dfe88216(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f116a78b-70d0-40cc-ab8b-5d4975c6b20a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:13 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 Sep 30 10:42:13 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:13 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216" returned: 0 in 0.514s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:13 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 Sep 30 10:42:13 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:13 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0" returned: 0 in 0.319s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:13 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0 Sep 30 10:42:13 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:13 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216.cb5ee2c9-e697-466b-9e3b-5cf4145543a0" returned: 0 in 0.241s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-cb5ee2c9-e697-466b-9e3b-5cf4145543a0" released by "_delete_snapshot" :: held 1.517s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-88fa49ec-742d-4773-bc42-5095dfe88216" released by "delete_snapshot" :: held 1.538s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:14 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Created reservations ['ab450d0b-aa5b-4c0f-8b0f-4ac284ebb155', '5398d93b-77fd-41a6-ad33-76cceaa4cadb', '6918d819-4f1c-46e3-b47c-7a6d95eb6a5b', 'aaa804bd-2f13-4556-9701-298e97e6663e'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:14 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Delete snapshot completed successfully. Sep 30 10:42:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3dbbd381-6b0b-47be-9c63-472e86453c6e tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-cb5ee2c9-e697-466b-9e3b-5cf4145543a0-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "cinder-88fa49ec-742d-4773-bc42-5095dfe88216-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-88fa49ec-742d-4773-bc42-5095dfe88216-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "cinder-quobyte-88fa49ec-742d-4773-bc42-5095dfe88216" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-88fa49ec-742d-4773-bc42-5095dfe88216" acquired by "delete_volume" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:14 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a8f42-03a2-45bf-b26b-a888e6e7bc12]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:14 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 Sep 30 10:42:14 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:15 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216" returned: 0 in 0.345s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:15 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216 Sep 30 10:42:15 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:15 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-88fa49ec-742d-4773-bc42-5095dfe88216" returned: 0 in 0.241s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-88fa49ec-742d-4773-bc42-5095dfe88216" released by "delete_volume" :: held 0.644s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Created reservations ['6e80f4a1-9964-46e5-b522-56695f86634f', 'c0af1881-50a6-4fe0-b5dd-95fad1ded780', '6a736d19-192a-46d7-bd79-d95d61563d2e', '73c0509b-aaea-4173-b1ba-52e7304527e3'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:15 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:15 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:15 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.235s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:15 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Deleted volume successfully. Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9545f319-1d08-4a9f-ad21-47c624b2170a tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-88fa49ec-742d-4773-bc42-5095dfe88216-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "cinder-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "cinder-quobyte-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" acquired by "delete_volume" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d71a7-ca10-4ead-a587-89f5b200b942]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:15 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 Sep 30 10:42:15 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:16 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" returned: 0 in 0.354s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:16 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77 Sep 30 10:42:16 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:16 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" returned: 0 in 0.243s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-quobyte-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77" released by "delete_volume" :: held 0.638s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Created reservations ['f6379b55-182d-4dd3-90b6-977ea124afcd', '51a7cb34-8f3d-467d-9f12-3595e70a1bbb', '007da567-44c3-4268-a53d-9d769d47ddee', '7f65ea2f-6480-4e91-b43b-8f1db8944b2d'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:16 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:16 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:16 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.251s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:16 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Deleted volume successfully. Sep 30 10:42:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a0ea8ec9-f30e-459d-b4de-a6fac4514aef tempest-SnapshotDependencyTests-467467614 None] Lock "cinder-3c0e0d89-e326-4adf-a7ee-f4f6ccc3eb77-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:26 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=20,cinder:UPDATE=28,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:42:26 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:37 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:37 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:37 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.410s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (e0c341fb-1e88-49b8-bac6-9c90eac0c9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3844d877-e18b-4850-8370-91918b2a894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3844d877-e18b-4850-8370-91918b2a894e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-511403720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2abd5c4-7617-4600-8047-c3ea3f21176e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:37Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d45600b-6006-4d77-b5e3-35ea51446bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d45600b-6006-4d77-b5e3-35ea51446bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf4d388-3545-449f-a958-48a55d2c6cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf4d388-3545-449f-a958-48a55d2c6cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2abd5c4-7617-4600-8047-c3ea3f21176e', 'volume_name': 'volume-c2abd5c4-7617-4600-8047-c3ea3f21176e', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1d9175-d758-412b-9fa7-3dbfbfcf3c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1d9175-d758-412b-9fa7-3dbfbfcf3c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba82a7d-f55e-436e-aa24-e2f8a25cef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:37 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume c2abd5c4-7617-4600-8047-c3ea3f21176e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2abd5c4-7617-4600-8047-c3ea3f21176e', 'volume_size': 1} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-511403720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2abd5c4-7617-4600-8047-c3ea3f21176e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:37Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Creating volume c2abd5c4-7617-4600-8047-c3ea3f21176e {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:37 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:37 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e 1073741824 Sep 30 10:42:37 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Flow 'volume_create_manager' (09d24a29-5a59-45c1-8d05-f568ae323c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f3a9ad-23a8-492f-b536-555e06eb0768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f3a9ad-23a8-492f-b536-555e06eb0768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1524178107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c53c7f-1c0e-4318-947a-c5a95b9f6406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49191338b1494f099cce9af1e0a591d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:38Z,use_quota=True,user_id='134af39219ce48119bebe2512d5006bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf54cf2-ff55-4fea-bd56-0162feaeefa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf54cf2-ff55-4fea-bd56-0162feaeefa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209b54d6-d0ce-47db-930b-fb7ca00d52bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209b54d6-d0ce-47db-930b-fb7ca00d52bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c53c7f-1c0e-4318-947a-c5a95b9f6406', 'volume_name': 'volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e0b08b-c422-48db-8549-d6b21ecd35da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e0b08b-c422-48db-8549-d6b21ecd35da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35705b4a-86bd-4246-a919-1ffee6e254a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:37 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Volume 77c53c7f-1c0e-4318-947a-c5a95b9f6406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406', 'volume_size': 1} Sep 30 10:42:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Flow 'volume_create_manager' (e2ee9a6f-2a4e-4476-a053-31bba39c5480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722021ff-ec19-47f4-b283-43fc37789535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722021ff-ec19-47f4-b283-43fc37789535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1374646137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1439e6-06c3-4ba1-838f-edd44a437ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49191338b1494f099cce9af1e0a591d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:38Z,use_quota=True,user_id='134af39219ce48119bebe2512d5006bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea6447c1-1247-4469-8e5d-396603783ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea6447c1-1247-4469-8e5d-396603783ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9922e6-67a9-4c3e-b71f-67ebb31246e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9922e6-67a9-4c3e-b71f-67ebb31246e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1439e6-06c3-4ba1-838f-edd44a437ae3', 'volume_name': 'volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f713fcf6-7139-4c5f-a7bf-7ff124714526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f713fcf6-7139-4c5f-a7bf-7ff124714526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0102b22e-d57a-45f0-a24c-1b01d5e39238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:38 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Volume dc1439e6-06c3-4ba1-838f-edd44a437ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3', 'volume_size': 1} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e 1073741824" returned: 0 in 0.676s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:38 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:38 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e Sep 30 10:42:38 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:38 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e" returned: 0 in 0.423s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.904s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1524178107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c53c7f-1c0e-4318-947a-c5a95b9f6406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49191338b1494f099cce9af1e0a591d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:38Z,use_quota=True,user_id='134af39219ce48119bebe2512d5006bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Creating volume 77c53c7f-1c0e-4318-947a-c5a95b9f6406 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:38 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba82a7d-f55e-436e-aa24-e2f8a25cef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2abd5c4-7617-4600-8047-c3ea3f21176e', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d748f62d-349f-45b8-a8cb-595ed20a2e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:38 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406 1073741824 Sep 30 10:42:38 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:38 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume volume-c2abd5c4-7617-4600-8047-c3ea3f21176e (c2abd5c4-7617-4600-8047-c3ea3f21176e): created successfully Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d748f62d-349f-45b8-a8cb-595ed20a2e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (e0c341fb-1e88-49b8-bac6-9c90eac0c9cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Flow 'volume_create_manager' (6f74b4d9-eedf-44d5-8224-47d9ecb3bac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3bbb6d-690c-44d5-ad52-3a695f58f2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-29b1ec9f-f66c-4e82-8368-1e49e9dd8297 tempest-CreateVolumesFromSnapshotTest-463546422 None] Created volume successfully. Sep 30 10:42:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3bbb6d-690c-44d5-ad52-3a695f58f2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425856597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f3ba9a5-26a0-4917-8180-af0441e0aec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49191338b1494f099cce9af1e0a591d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:39Z,use_quota=True,user_id='134af39219ce48119bebe2512d5006bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2be2ca8-8113-4217-bdf3-131daf268e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2be2ca8-8113-4217-bdf3-131daf268e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667bc77f-5d62-4b8f-bf14-bab8902c6a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667bc77f-5d62-4b8f-bf14-bab8902c6a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f3ba9a5-26a0-4917-8180-af0441e0aec2', 'volume_name': 'volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df928d1b-c8b0-478a-a70d-0c71d44c90c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df928d1b-c8b0-478a-a70d-0c71d44c90c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e64da71-5c05-4a30-baa0-ccbcf58ada2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Volume 4f3ba9a5-26a0-4917-8180-af0441e0aec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2', 'volume_size': 1} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:39 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406 1073741824" returned: 0 in 0.572s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:39 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406 Sep 30 10:42:39 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Flow 'volume_create_manager' (914a3607-5426-4102-bacb-6a6f9d6f63bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764cb66a-3178-468c-9854-7dd73fc47f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764cb66a-3178-468c-9854-7dd73fc47f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-581988955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49191338b1494f099cce9af1e0a591d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:39Z,use_quota=True,user_id='134af39219ce48119bebe2512d5006bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4e3e7f-d74f-4685-b1ed-99a105b4a6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4e3e7f-d74f-4685-b1ed-99a105b4a6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c070bcf-523a-46ee-99ea-475fad30e39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c070bcf-523a-46ee-99ea-475fad30e39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf', 'volume_name': 'volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc46ae68-5b3f-4006-8569-03f396a48d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc46ae68-5b3f-4006-8569-03f396a48d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2426ed13-9726-415c-9ca8-ed31e08eb7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Volume fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf', 'volume_size': 1} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Flow 'volume_create_manager' (ce38584a-4a6d-40af-9531-00c6051f10e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:39 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adcb84c-25c2-43e3-a67a-947a8e1728b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406" returned: 0 in 0.375s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1374646137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1439e6-06c3-4ba1-838f-edd44a437ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49191338b1494f099cce9af1e0a591d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:38Z,use_quota=True,user_id='134af39219ce48119bebe2512d5006bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Creating volume dc1439e6-06c3-4ba1-838f-edd44a437ae3 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:39 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adcb84c-25c2-43e3-a67a-947a8e1728b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-35572884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efced46-a5fc-4bd6-91c1-3725554e0c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49191338b1494f099cce9af1e0a591d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:40Z,use_quota=True,user_id='134af39219ce48119bebe2512d5006bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a90937-088a-479d-9951-473a88d7b03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3 1073741824 Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a90937-088a-479d-9951-473a88d7b03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22757e34-27b0-4ff8-b476-dc121665d3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22757e34-27b0-4ff8-b476-dc121665d3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1efced46-a5fc-4bd6-91c1-3725554e0c91', 'volume_name': 'volume-1efced46-a5fc-4bd6-91c1-3725554e0c91', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed089b3a-0528-437c-b4ce-e99b14d1b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed089b3a-0528-437c-b4ce-e99b14d1b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aced378b-55bb-4b38-9721-884965d51d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Volume 1efced46-a5fc-4bd6-91c1-3725554e0c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1efced46-a5fc-4bd6-91c1-3725554e0c91', 'volume_size': 1} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35705b4a-86bd-4246-a919-1ffee6e254a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed5fe18-3c22-4ce0-a7a4-81528d5802a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:39 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Volume volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406 (77c53c7f-1c0e-4318-947a-c5a95b9f6406): created successfully Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed5fe18-3c22-4ce0-a7a4-81528d5802a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Flow 'volume_create_manager' (09d24a29-5a59-45c1-8d05-f568ae323c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-648b70d7-8b08-4c50-90ee-1c235a51d60d tempest-CreateVolumesFromImageTest-1862390807 None] Created volume successfully. Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:40 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3 1073741824" returned: 0 in 0.631s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:40 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3 Sep 30 10:42:40 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:40 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3" returned: 0 in 0.329s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.824s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425856597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f3ba9a5-26a0-4917-8180-af0441e0aec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49191338b1494f099cce9af1e0a591d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:39Z,use_quota=True,user_id='134af39219ce48119bebe2512d5006bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Creating volume 4f3ba9a5-26a0-4917-8180-af0441e0aec2 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:40 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:40 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2 1073741824 Sep 30 10:42:40 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0102b22e-d57a-45f0-a24c-1b01d5e39238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0392acd3-b4a9-4a2a-8b69-75ad79f82d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:40 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Volume volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3 (dc1439e6-06c3-4ba1-838f-edd44a437ae3): created successfully Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0392acd3-b4a9-4a2a-8b69-75ad79f82d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Flow 'volume_create_manager' (e2ee9a6f-2a4e-4476-a053-31bba39c5480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:41 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-bdc4c2d1-dfed-479e-82c2-6ae2b2ef6a6a tempest-CreateVolumesFromImageTest-1862390807 None] Created volume successfully. Sep 30 10:42:41 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2 1073741824" returned: 0 in 0.502s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:41 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2 Sep 30 10:42:41 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:41 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2" returned: 0 in 0.257s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.025s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-581988955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49191338b1494f099cce9af1e0a591d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:39Z,use_quota=True,user_id='134af39219ce48119bebe2512d5006bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Creating volume fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:41 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:41 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf 1073741824 Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e64da71-5c05-4a30-baa0-ccbcf58ada2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:41 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a15e69-5a30-421e-9806-01f27ddc36ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:41 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Volume volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2 (4f3ba9a5-26a0-4917-8180-af0441e0aec2): created successfully Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a15e69-5a30-421e-9806-01f27ddc36ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:41 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Flow 'volume_create_manager' (6f74b4d9-eedf-44d5-8224-47d9ecb3bac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:41 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e4bb86f1-499b-46be-bb2a-7099eb68b58a tempest-CreateVolumesFromImageTest-1862390807 None] Created volume successfully. Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Flow 'volume_create_manager' (bb33a3ae-4315-4b74-ba2b-ba8c21fcd83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89d7f86-6b78-4358-973e-670258e1c152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89d7f86-6b78-4358-973e-670258e1c152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8952db48-6832-4988-a37b-57d67ea0c814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0a6e04afa34e39bb74c870bbf8a3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:42Z,use_quota=True,user_id='10de04c716614aa98e6c2be6f6ec7dcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfeae725-cc90-42d9-a946-16ea78d65f86),volume_type_id=dfeae725-cc90-42d9-a946-16ea78d65f86)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15aed014-d6f5-498c-8500-9941e5d1e5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15aed014-d6f5-498c-8500-9941e5d1e5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5229fb-b22a-4157-adc2-cd9901820f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.image.glance [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Creating Keystone auth plugin from conf {{(pid=87013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 10:42:42 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf 1073741824" returned: 0 in 0.529s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:42 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf Sep 30 10:42:42 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5229fb-b22a-4157-adc2-cd9901820f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8952db48-6832-4988-a37b-57d67ea0c814', 'volume_name': 'volume-8952db48-6832-4988-a37b-57d67ea0c814', 'volume_size': 1, 'image_id': '72ef897b-4e83-453f-aa6a-327fcd6844af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72ef897b-4e83-453f-aa6a-327fcd6844af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '41ff0303835123f0e323b963ceb9604b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9b0a6e04afa34e39bb74c870bbf8a3f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '013dadf4d29c33a2d716b55a23b921938d1afbdb6a9b326f8ed8399a79fa6b8947108de6b7fd94cd22cf3d1f63397c3ae1b40d184c138e43a913e60eae80c96b', 'id': '72ef897b-4e83-453f-aa6a-327fcd6844af', 'created_at': datetime.datetime(2026, 9, 30, 8, 42, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 42, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72ef897b-4e83-453f-aa6a-327fcd6844af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:42 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d526cdc3-74b0-455c-a4d8-73316d160506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d526cdc3-74b0-455c-a4d8-73316d160506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bf81bc-ba35-429c-8c99-24aa99100bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:42 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Volume 8952db48-6832-4988-a37b-57d67ea0c814: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8952db48-6832-4988-a37b-57d67ea0c814', 'volume_size': 1, 'image_id': '72ef897b-4e83-453f-aa6a-327fcd6844af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72ef897b-4e83-453f-aa6a-327fcd6844af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '41ff0303835123f0e323b963ceb9604b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9b0a6e04afa34e39bb74c870bbf8a3f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '013dadf4d29c33a2d716b55a23b921938d1afbdb6a9b326f8ed8399a79fa6b8947108de6b7fd94cd22cf3d1f63397c3ae1b40d184c138e43a913e60eae80c96b', 'id': '72ef897b-4e83-453f-aa6a-327fcd6844af', 'created_at': datetime.datetime(2026, 9, 30, 8, 42, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 42, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72ef897b-4e83-453f-aa6a-327fcd6844af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Trying to clone 8952db48-6832-4988-a37b-57d67ea0c814 from image 72ef897b-4e83-453f-aa6a-327fcd6844af at location (None, [{'url': 'file:///opt/stack/data/glance/images/72ef897b-4e83-453f-aa6a-327fcd6844af', 'metadata': {}}]). {{(pid=87013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf" returned: 0 in 0.289s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.618s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-35572884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efced46-a5fc-4bd6-91c1-3725554e0c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49191338b1494f099cce9af1e0a591d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:40Z,use_quota=True,user_id='134af39219ce48119bebe2512d5006bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Creating volume 1efced46-a5fc-4bd6-91c1-3725554e0c91 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:42 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:42 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91 1073741824 Sep 30 10:42:42 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2426ed13-9726-415c-9ca8-ed31e08eb7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c91f761-5f1a-4317-b3d6-e365138638e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 10:42:42 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Image download 0.00 MB at 0.00 MB/s Sep 30 10:42:42 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Volume volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf (fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf): created successfully Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c91f761-5f1a-4317-b3d6-e365138638e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Flow 'volume_create_manager' (914a3607-5426-4102-bacb-6a6f9d6f63bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:42 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e0b963a7-bec6-4a17-a81d-05412dc0787a tempest-CreateVolumesFromImageTest-1862390807 None] Created volume successfully. Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e57f595-538d-47b0-9895-34b1514040c2]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:42 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD Sep 30 10:42:42 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:43 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:43 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91 1073741824" returned: 0 in 0.588s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:43 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91 Sep 30 10:42:43 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:43 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD Sep 30 10:42:43 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:43 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91" returned: 0 in 0.245s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.375s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aced378b-55bb-4b38-9721-884965d51d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efced46-a5fc-4bd6-91c1-3725554e0c91', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121f811d-2e5a-4a5b-bbab-ea4593a2582d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Creating offline snapshot 8b54f4ca-224f-4783-900f-9ff24ed42254 of volume c2abd5c4-7617-4600-8047-c3ea3f21176e {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:42:43 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Temporary image 72ef897b-4e83-453f-aa6a-327fcd6844af is fetched for user 10de04c716614aa98e6c2be6f6ec7dcf. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 10:42:43 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Volume volume-1efced46-a5fc-4bd6-91c1-3725554e0c91 (1efced46-a5fc-4bd6-91c1-3725554e0c91): created successfully Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121f811d-2e5a-4a5b-bbab-ea4593a2582d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Flow 'volume_create_manager' (ce38584a-4a6d-40af-9531-00c6051f10e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5551e60-7492-4df1-866c-7f36675ae375]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a7da439b-ab37-41d6-9705-8351162b284c tempest-CreateVolumesFromImageTest-1862390807 None] Created volume successfully. Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[340706a7-2274-434b-860e-576922ed6c26]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:43 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e Sep 30 10:42:43 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:43 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD Sep 30 10:42:43 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:43 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e" returned: 0 in 0.357s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:43 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 1G Sep 30 10:42:43 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:43 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:44 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD Sep 30 10:42:44 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "cinder-1efced46-a5fc-4bd6-91c1-3725554e0c91-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-1efced46-a5fc-4bd6-91c1-3725554e0c91-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:44 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "cinder-quobyte-1efced46-a5fc-4bd6-91c1-3725554e0c91" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-quobyte-1efced46-a5fc-4bd6-91c1-3725554e0c91" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2437e6e-a053-4abe-b7d8-8492f37782a2]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:44 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 1G" returned: 0 in 0.523s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2abd5c4-7617-4600-8047-c3ea3f21176e -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:44 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2abd5c4-7617-4600-8047-c3ea3f21176e -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 Sep 30 10:42:44 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:44 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91 Sep 30 10:42:44 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:44 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2abd5c4-7617-4600-8047-c3ea3f21176e -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254" returned: 0 in 0.323s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:44 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 is being set with open permissions: ugo+rw Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:44 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 Sep 30 10:42:44 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:44 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91" returned: 0 in 0.389s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:44 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91 Sep 30 10:42:44 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:45 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254" returned: 0 in 0.274s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:45 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1efced46-a5fc-4bd6-91c1-3725554e0c91" returned: 0 in 0.275s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-quobyte-1efced46-a5fc-4bd6-91c1-3725554e0c91" released by "delete_volume" :: held 0.714s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:45 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.info Sep 30 10:42:45 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Created reservations ['d654ddeb-529c-46f4-8204-f52d6099108b', 'f8d938d6-b156-4d21-98e1-a7e1b694e0c4', 'dba87588-bbaa-4934-b2e4-722c3baa7a0b', 'aa6dfc57-c083-4397-aa06-b3e4807d97e3'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:45 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:45 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:45 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.info" returned: 0 in 0.286s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:45 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.info is being set with open permissions: ugo+rw Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:45 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.info Sep 30 10:42:45 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:45 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.269s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:45 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Deleted volume successfully. Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "cinder-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f184958-01d4-4f44-9189-0c540f9573e9 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-1efced46-a5fc-4bd6-91c1-3725554e0c91-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "cinder-quobyte-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-quobyte-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf" acquired by "delete_volume" :: waited 0.040s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:45 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.info" returned: 0 in 0.342s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91b3e43-836a-4a6d-afa0-d046da9c643f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8952db48-6832-4988-a37b-57d67ea0c814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0a6e04afa34e39bb74c870bbf8a3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:42Z,use_quota=True,user_id='10de04c716614aa98e6c2be6f6ec7dcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfeae725-cc90-42d9-a946-16ea78d65f86),volume_type_id=dfeae725-cc90-42d9-a946-16ea78d65f86)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Creating volume 8952db48-6832-4988-a37b-57d67ea0c814 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:45 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:45 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 1073741824 Sep 30 10:42:45 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:45 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7236817d-ce1a-4f09-b568-fa8b7ade265c tempest-CreateVolumesFromSnapshotTest-463546422 None] Create snapshot completed successfully Sep 30 10:42:45 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf Sep 30 10:42:45 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:46 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf" returned: 0 in 0.431s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:46 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf Sep 30 10:42:46 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:46 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 1073741824" returned: 0 in 0.502s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:46 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 Sep 30 10:42:46 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:46 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf" returned: 0 in 0.284s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-quobyte-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf" released by "delete_volume" :: held 0.808s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Created reservations ['2ef3b203-ee26-4579-8d1b-67a9d5b902c2', '60c8f255-18a2-406f-ad9c-d2f6e1c0960f', '821df4e9-381f-416a-a674-34ef1a2490af', 'd10302c2-1f03-48e0-abbc-fe90145da8c9'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:46 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814" returned: 0 in 0.350s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Attempting download of 72ef897b-4e83-453f-aa6a-327fcd6844af ((None, [{'url': 'file:///opt/stack/data/glance/images/72ef897b-4e83-453f-aa6a-327fcd6844af', 'metadata': {}}])) to volume 8952db48-6832-4988-a37b-57d67ea0c814. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:46 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:46 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e739b369-325a-4a9b-a576-316c174dee47]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72ef897b-4e83-453f-aa6a-327fcd6844af_z49boeyr {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "cinder-4f3ba9a5-26a0-4917-8180-af0441e0aec2-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-4f3ba9a5-26a0-4917-8180-af0441e0aec2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "cinder-quobyte-4f3ba9a5-26a0-4917-8180-af0441e0aec2" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-quobyte-4f3ba9a5-26a0-4917-8180-af0441e0aec2" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc796b25-722b-49d8-8f6b-eb342b51eda4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:47 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72ef897b-4e83-453f-aa6a-327fcd6844af_z49boeyr Sep 30 10:42:47 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:47 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.423s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:47 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2 Sep 30 10:42:47 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:47 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Deleted volume successfully. Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-74ef3b4f-172d-4f67-a88b-799c3078b9d3 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-fa5ea8d7-47f7-445c-bfdc-b9b0be9f0acf-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (c825782c-ced0-4e72-a257-e73458c108a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487d0ada-5bfc-4da0-8b49-1b8cc5c58c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487d0ada-5bfc-4da0-8b49-1b8cc5c58c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1820951107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90eb33b6-9a7f-4975-9536-125ff6b2decb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:47Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fb8881-32de-414a-806b-37b861281faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:47 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fb8881-32de-414a-806b-37b861281faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b384d2-427e-4b21-a597-2eac476ea8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b384d2-427e-4b21-a597-2eac476ea8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90eb33b6-9a7f-4975-9536-125ff6b2decb', 'volume_name': 'volume-90eb33b6-9a7f-4975-9536-125ff6b2decb', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82738259-b868-4cb4-acaa-660aa0f59630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82738259-b868-4cb4-acaa-660aa0f59630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75172884-bfa5-42eb-972a-410efc5038e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:47 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume 90eb33b6-9a7f-4975-9536-125ff6b2decb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90eb33b6-9a7f-4975-9536-125ff6b2decb', 'volume_size': 1} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1820951107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90eb33b6-9a7f-4975-9536-125ff6b2decb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:47Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Creating volume 90eb33b6-9a7f-4975-9536-125ff6b2decb {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:47 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72ef897b-4e83-453f-aa6a-327fcd6844af_z49boeyr" returned: 0 in 0.741s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72ef897b-4e83-453f-aa6a-327fcd6844af_z49boeyr {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:47 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb 1073741824 Sep 30 10:42:47 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:47 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2" returned: 0 in 0.675s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:47 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72ef897b-4e83-453f-aa6a-327fcd6844af_z49boeyr Sep 30 10:42:47 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:47 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2 Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:47 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (9e481380-451a-4acd-b78f-a3f2adede205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8927212-fe19-4c39-b51a-57814f8ddc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8927212-fe19-4c39-b51a-57814f8ddc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564695392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1208baae-ffcf-4d55-8259-d4ef0230963d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:48Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7c28f5-5199-498a-a755-f19b649ca213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7c28f5-5199-498a-a755-f19b649ca213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9a3107-0030-4bfa-9adb-92085c566c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9a3107-0030-4bfa-9adb-92085c566c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1208baae-ffcf-4d55-8259-d4ef0230963d', 'volume_name': 'volume-1208baae-ffcf-4d55-8259-d4ef0230963d', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7403be25-ada6-42c6-a5fe-18572d217e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7403be25-ada6-42c6-a5fe-18572d217e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8911679-2e5c-4943-be60-e7eef1c7c284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:47 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume 1208baae-ffcf-4d55-8259-d4ef0230963d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1208baae-ffcf-4d55-8259-d4ef0230963d', 'volume_size': 1} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:47 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72ef897b-4e83-453f-aa6a-327fcd6844af_z49boeyr" returned: 1 in 0.458s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72ef897b-4e83-453f-aa6a-327fcd6844af_z49boeyr' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68eab81-3633-4299-a4c2-c1e5e35d73fb]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:48 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-4f3ba9a5-26a0-4917-8180-af0441e0aec2" returned: 0 in 0.452s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-quobyte-4f3ba9a5-26a0-4917-8180-af0441e0aec2" released by "delete_volume" :: held 1.230s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:48 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD Sep 30 10:42:48 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:48 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb 1073741824" returned: 0 in 0.774s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Created reservations ['93681136-4a86-491e-98e5-b3b069f17b34', 'f5649513-f6fa-4933-bd70-97d336482985', '0152ed84-2e4f-46d9-a549-7ff36888c16a', 'aa502e14-08ec-4bf7-ae4e-cf2c5f40cba8'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:48 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb Sep 30 10:42:48 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (c3a00c18-7d61-4e40-b6b9-5aa72a9428ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2666857-23c9-40a6-8b43-ef14ed9551bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2666857-23c9-40a6-8b43-ef14ed9551bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-185804113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2a8179-5af3-4702-bcd4-aa4183c1cb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:48Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bba0986-8a0f-4d34-b112-86809558f3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bba0986-8a0f-4d34-b112-86809558f3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6eb3606-ecec-4d78-be3d-57d63c9b6b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6eb3606-ecec-4d78-be3d-57d63c9b6b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2a8179-5af3-4702-bcd4-aa4183c1cb0f', 'volume_name': 'volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8804d44-88fb-4b63-81d8-7ee6533ef842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8804d44-88fb-4b63-81d8-7ee6533ef842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440452c7-4dcb-4d24-8b38-55f7684f9d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:48 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume 5e2a8179-5af3-4702-bcd4-aa4183c1cb0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f', 'volume_size': 1} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:48 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:48 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:48 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (30d307ba-c4ad-4bb1-aa33-ebb64c36b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:48 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae6244a-80cc-4fc4-9846-013a629e6762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:48 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD Sep 30 10:42:48 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb" returned: 0 in 0.498s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564695392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1208baae-ffcf-4d55-8259-d4ef0230963d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:48Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Creating volume 1208baae-ffcf-4d55-8259-d4ef0230963d {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:48 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae6244a-80cc-4fc4-9846-013a629e6762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120078090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84669591-ebe1-4815-b21f-cf5266c8b72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:49Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:48 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d 1073741824 Sep 30 10:42:48 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb5cab6-a0d4-46d5-ac50-dd4e3283e0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb5cab6-a0d4-46d5-ac50-dd4e3283e0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4863b9-4f3b-43a9-a50a-b1a1641d7c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4863b9-4f3b-43a9-a50a-b1a1641d7c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84669591-ebe1-4815-b21f-cf5266c8b72e', 'volume_name': 'volume-84669591-ebe1-4815-b21f-cf5266c8b72e', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63952606-64a7-4683-888f-a009f66bac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63952606-64a7-4683-888f-a009f66bac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c35231f-3041-46e2-8845-64c8cfcf8eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:48 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume 84669591-ebe1-4815-b21f-cf5266c8b72e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84669591-ebe1-4815-b21f-cf5266c8b72e', 'volume_size': 1} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:48 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.389s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:48 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75172884-bfa5-42eb-972a-410efc5038e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90eb33b6-9a7f-4975-9536-125ff6b2decb', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439e7f1f-b4b7-4f63-bcd2-02bc32707e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:49 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Deleted volume successfully. Sep 30 10:42:49 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume volume-90eb33b6-9a7f-4975-9536-125ff6b2decb (90eb33b6-9a7f-4975-9536-125ff6b2decb): created successfully Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439e7f1f-b4b7-4f63-bcd2-02bc32707e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (c825782c-ced0-4e72-a257-e73458c108a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-70cad1e3-a88b-4732-91a8-c0b12a34e239 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-4f3ba9a5-26a0-4917-8180-af0441e0aec2-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:49 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-dade74b4-6aed-4a3f-a410-aa090675f4f7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Created volume successfully. Sep 30 10:42:49 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD" returned: 1 in 0.607s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] 72ef897b-4e83-453f-aa6a-327fcd6844af was raw, converting to qcow2 {{(pid=87013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:49 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 Sep 30 10:42:49 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "cinder-dc1439e6-06c3-4ba1-838f-edd44a437ae3-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-dc1439e6-06c3-4ba1-838f-edd44a437ae3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "cinder-quobyte-dc1439e6-06c3-4ba1-838f-edd44a437ae3" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-quobyte-dc1439e6-06c3-4ba1-838f-edd44a437ae3" acquired by "delete_volume" :: waited 0.040s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (75d17600-f812-448b-b339-125a7149e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:49 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640c1216-b0e7-4e0f-9693-5f84eb2dc828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef964bfa-bbed-43ed-ae53-dd04871b650c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d 1073741824" returned: 0 in 0.683s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640c1216-b0e7-4e0f-9693-5f84eb2dc828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-542376137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdea9a8-a469-4ea7-9120-25518f8bcc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:49Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1ceafb-4efb-4c78-a513-f170fc87e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1ceafb-4efb-4c78-a513-f170fc87e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17a9242-df46-4568-bbf5-36621a411a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17a9242-df46-4568-bbf5-36621a411a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bdea9a8-a469-4ea7-9120-25518f8bcc11', 'volume_name': 'volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0886d26c-ca5d-4eb9-8e69-26813ec3373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0886d26c-ca5d-4eb9-8e69-26813ec3373d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1304523-0e2c-4f17-822f-dd14ffd5fb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:49 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume 3bdea9a8-a469-4ea7-9120-25518f8bcc11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11', 'volume_size': 1} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:49 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d Sep 30 10:42:49 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:49 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3 Sep 30 10:42:49 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:49 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814" returned: 0 in 0.673s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72ef897b-4e83-453f-aa6a-327fcd6844af_ss7gpk6idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:42:49 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:49 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 1G Sep 30 10:42:49 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:49 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d" returned: 0 in 0.294s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-185804113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2a8179-5af3-4702-bcd4-aa4183c1cb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:48Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Creating volume 5e2a8179-5af3-4702-bcd4-aa4183c1cb0f {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:49 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8911679-2e5c-4943-be60-e7eef1c7c284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1208baae-ffcf-4d55-8259-d4ef0230963d', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:49 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f 1073741824 Sep 30 10:42:49 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7855b802-f0b8-4b6c-814a-60239737dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:49 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume volume-1208baae-ffcf-4d55-8259-d4ef0230963d (1208baae-ffcf-4d55-8259-d4ef0230963d): created successfully Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7855b802-f0b8-4b6c-814a-60239737dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (9e481380-451a-4acd-b78f-a3f2adede205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:50 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-4a8926f9-d095-4681-ad2d-ab1438244962 tempest-CreateVolumesFromSnapshotTest-463546422 None] Created volume successfully. Sep 30 10:42:50 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3" returned: 0 in 0.532s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:50 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3 Sep 30 10:42:50 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:50 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 1G" returned: 0 in 0.353s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Downloaded image 72ef897b-4e83-453f-aa6a-327fcd6844af ((None, [{'url': 'file:///opt/stack/data/glance/images/72ef897b-4e83-453f-aa6a-327fcd6844af', 'metadata': {}}])) to volume 8952db48-6832-4988-a37b-57d67ea0c814 successfully. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Temporary image 72ef897b-4e83-453f-aa6a-327fcd6844af for user 10de04c716614aa98e6c2be6f6ec7dcf is deleted. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Marking volume 8952db48-6832-4988-a37b-57d67ea0c814 as bootable. {{(pid=87013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Copying metadata from image 72ef897b-4e83-453f-aa6a-327fcd6844af to 8952db48-6832-4988-a37b-57d67ea0c814. {{(pid=87013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Creating volume glance metadata for volume 8952db48-6832-4988-a37b-57d67ea0c814 backed by image 72ef897b-4e83-453f-aa6a-327fcd6844af with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '72ef897b-4e83-453f-aa6a-327fcd6844af', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '41ff0303835123f0e323b963ceb9604b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bf81bc-ba35-429c-8c99-24aa99100bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8952db48-6832-4988-a37b-57d67ea0c814', 'volume_size': 1, 'image_id': '72ef897b-4e83-453f-aa6a-327fcd6844af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72ef897b-4e83-453f-aa6a-327fcd6844af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '41ff0303835123f0e323b963ceb9604b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9b0a6e04afa34e39bb74c870bbf8a3f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '013dadf4d29c33a2d716b55a23b921938d1afbdb6a9b326f8ed8399a79fa6b8947108de6b7fd94cd22cf3d1f63397c3ae1b40d184c138e43a913e60eae80c96b', 'id': '72ef897b-4e83-453f-aa6a-327fcd6844af', 'created_at': datetime.datetime(2026, 9, 30, 8, 42, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 42, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72ef897b-4e83-453f-aa6a-327fcd6844af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b66269-4098-4c5f-a5df-65e191a357ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:50 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Volume volume-8952db48-6832-4988-a37b-57d67ea0c814 (8952db48-6832-4988-a37b-57d67ea0c814): created successfully Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b66269-4098-4c5f-a5df-65e191a357ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:50 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Flow 'volume_create_manager' (bb33a3ae-4315-4b74-ba2b-ba8c21fcd83e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dc1439e6-06c3-4ba1-838f-edd44a437ae3" returned: 0 in 0.272s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-quobyte-dc1439e6-06c3-4ba1-838f-edd44a437ae3" released by "delete_volume" :: held 0.917s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:50 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f79ddddf-69c5-43ff-b3e9-244271eb0ec9 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Created volume successfully. Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Created reservations ['11043f80-a661-4634-b4ed-463917b97767', '35846471-e786-45f7-9d13-f93381945f8b', '0474c85b-4fe5-494b-bc9f-6296de84288a', '6e91a0e0-5570-4f5c-a639-b9bdfbddd797'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:50 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f 1073741824" returned: 0 in 0.533s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:50 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:50 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "cinder-77c53c7f-1c0e-4318-947a-c5a95b9f6406-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:50 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f Sep 30 10:42:50 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-77c53c7f-1c0e-4318-947a-c5a95b9f6406-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "cinder-quobyte-77c53c7f-1c0e-4318-947a-c5a95b9f6406" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-quobyte-77c53c7f-1c0e-4318-947a-c5a95b9f6406" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3363d412-d265-4709-8e3f-651146b73a55]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:50 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.439s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:50 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406 Sep 30 10:42:50 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:50 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Deleted volume successfully. Sep 30 10:42:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e3c8670f-8a57-480b-8966-6898065297fc tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-dc1439e6-06c3-4ba1-838f-edd44a437ae3-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:51 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f" returned: 0 in 0.434s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.033s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120078090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84669591-ebe1-4815-b21f-cf5266c8b72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:49Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Creating volume 84669591-ebe1-4815-b21f-cf5266c8b72e {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:51 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Acquiring lock "cinder-8952db48-6832-4988-a37b-57d67ea0c814-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:51 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e 1073741824 Sep 30 10:42:51 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440452c7-4dcb-4d24-8b38-55f7684f9d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b20fb6c-f17c-4a7f-949b-a3e1221b0437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Lock "cinder-8952db48-6832-4988-a37b-57d67ea0c814-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:51 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f (5e2a8179-5af3-4702-bcd4-aa4183c1cb0f): created successfully Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b20fb6c-f17c-4a7f-949b-a3e1221b0437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (c3a00c18-7d61-4e40-b6b9-5aa72a9428ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:51 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-563a2efb-dc1d-4270-898b-b64c769e2c2f tempest-CreateVolumesFromSnapshotTest-463546422 None] Created volume successfully. Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Acquiring lock "cinder-quobyte-8952db48-6832-4988-a37b-57d67ea0c814" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Lock "cinder-quobyte-8952db48-6832-4988-a37b-57d67ea0c814" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6a8ad6-a633-488c-9af6-74d626f5d591]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:51 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406" returned: 0 in 0.537s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:51 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406 Sep 30 10:42:51 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:51 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 Sep 30 10:42:51 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:51 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-77c53c7f-1c0e-4318-947a-c5a95b9f6406" returned: 0 in 0.349s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-quobyte-77c53c7f-1c0e-4318-947a-c5a95b9f6406" released by "delete_volume" :: held 0.952s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:51 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e 1073741824" returned: 0 in 0.685s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Created reservations ['44865ed7-c2d1-4946-ba71-23da95ed4b50', '476c41ac-7283-4c00-96cd-60151b3cf02e', '7188a59a-66cd-4bb5-a1b4-d26f910b4210', 'ce10bd6f-54e2-4248-ba8f-08d6a69fe1f9'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:51 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814" returned: 0 in 0.495s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:51 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814 Sep 30 10:42:51 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:51 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e Sep 30 10:42:51 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:51 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:51 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:52 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-8952db48-6832-4988-a37b-57d67ea0c814" returned: 0 in 0.342s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Lock "cinder-quobyte-8952db48-6832-4988-a37b-57d67ea0c814" released by "delete_volume" :: held 0.900s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:52 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e" returned: 0 in 0.359s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.566s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-542376137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdea9a8-a469-4ea7-9120-25518f8bcc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a4ddf89f46426c84881cc78339afb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:49Z,use_quota=True,user_id='f21d26ea2ca04c52a021848957646249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Creating volume 3bdea9a8-a469-4ea7-9120-25518f8bcc11 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:52 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c35231f-3041-46e2-8845-64c8cfcf8eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84669591-ebe1-4815-b21f-cf5266c8b72e', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41f84eb-4850-4cb3-b4d1-093e06c35f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:52 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11 1073741824 Sep 30 10:42:52 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:52 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.337s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Created reservations ['7a1d284a-6b21-410e-b6ce-e1432783c1f4', '1005bd9e-6c9b-4617-8def-527d7c86527f', 'c5752b28-7a25-4a7c-8378-0019cea4ae76', 'f9206008-1444-45d5-8994-0cbf15bb1852'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Deleted volume successfully. Sep 30 10:42:52 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume volume-84669591-ebe1-4815-b21f-cf5266c8b72e (84669591-ebe1-4815-b21f-cf5266c8b72e): created successfully Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41f84eb-4850-4cb3-b4d1-093e06c35f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (30d307ba-c4ad-4bb1-aa33-ebb64c36b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-408b61a9-c2ab-45db-98c6-4649c7f1910a tempest-CreateVolumesFromSnapshotTest-463546422 None] Created volume successfully. Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cd0bb61e-3ce9-4566-aca1-3348a456aca8 tempest-CreateVolumesFromImageTest-1862390807 None] Lock "cinder-77c53c7f-1c0e-4318-947a-c5a95b9f6406-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:52 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:52 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:52 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.259s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Deleted volume successfully. Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84d0057e-bfcf-43ae-b125-66e43b380ed7 tempest-VolumeAndVolumeTypeFromImageTest-1269077074 None] Lock "cinder-8952db48-6832-4988-a37b-57d67ea0c814-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:52 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11 1073741824" returned: 0 in 0.440s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:52 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11 Sep 30 10:42:52 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:52 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11" returned: 0 in 0.247s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1304523-0e2c-4f17-822f-dd14ffd5fb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ccca9c-6c32-4be2-ba02-37f5f221d2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:52 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Volume volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11 (3bdea9a8-a469-4ea7-9120-25518f8bcc11): created successfully Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ccca9c-6c32-4be2-ba02-37f5f221d2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Flow 'volume_create_manager' (75d17600-f812-448b-b339-125a7149e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-870d9580-1776-47b1-bdfc-8a508093892d tempest-CreateVolumesFromSnapshotTest-463546422 None] Created volume successfully. Sep 30 10:42:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-3bdea9a8-a469-4ea7-9120-25518f8bcc11-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-3bdea9a8-a469-4ea7-9120-25518f8bcc11-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-quobyte-3bdea9a8-a469-4ea7-9120-25518f8bcc11" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-3bdea9a8-a469-4ea7-9120-25518f8bcc11" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6406d440-87d0-41fb-9f2a-e0ca1a95d844]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:54 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11 Sep 30 10:42:54 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:54 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11" returned: 0 in 0.485s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:54 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11 Sep 30 10:42:54 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:54 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-3bdea9a8-a469-4ea7-9120-25518f8bcc11" returned: 0 in 0.325s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-3bdea9a8-a469-4ea7-9120-25518f8bcc11" released by "delete_volume" :: held 0.865s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Created reservations ['d2b18a46-3480-4cc2-9cb1-763e8a27daf2', '82013a27-8a77-42c1-a87e-c343c2cdf01c', 'a422d4ef-949b-457d-9a78-4596554a9e51', '9835e811-fa10-46bf-8714-589529c20fc1'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:55 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:55 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-84669591-ebe1-4815-b21f-cf5266c8b72e-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-84669591-ebe1-4815-b21f-cf5266c8b72e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-quobyte-84669591-ebe1-4815-b21f-cf5266c8b72e" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-84669591-ebe1-4815-b21f-cf5266c8b72e" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e723bf51-6bb4-4dce-9329-bf2091116252]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:55 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e Sep 30 10:42:55 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:55 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.544s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Deleted volume successfully. Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aea09f4c-759b-432f-a002-df81b2e7c6b1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-3bdea9a8-a469-4ea7-9120-25518f8bcc11-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:55 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e" returned: 0 in 0.517s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:56 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e Sep 30 10:42:56 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:56 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-84669591-ebe1-4815-b21f-cf5266c8b72e" returned: 0 in 0.275s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-84669591-ebe1-4815-b21f-cf5266c8b72e" released by "delete_volume" :: held 0.866s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Created reservations ['b5f4a2ca-fbf1-464f-985c-455bde2bd32f', '640eac2b-59c2-42d2-9dc3-5f33885e3460', '63dd8148-179f-471c-aa8a-de6202463533', 'd8486778-e8a9-404c-88e4-788e87f6e1e2'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:56 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:56 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-quobyte-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f" acquired by "delete_volume" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c068f005-5a9b-4545-b4e9-6179ea009493]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Flow 'volume_create_manager' (e221f73f-7712-48ce-94f7-54d62c63003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37dced7a-9e03-468d-8032-5df66afa7357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:56 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:56 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f Sep 30 10:42:56 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37dced7a-9e03-468d-8032-5df66afa7357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1295222577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cefa360-4948-44dd-a79a-4997044bfb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a5ff06af944945a368310619fb9792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:57Z,use_quota=True,user_id='b62225b2a89743069d25fa146ea653ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33174c7c-b347-4baf-b688-08575ebb9bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33174c7c-b347-4baf-b688-08575ebb9bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6925b22-721e-4066-908d-79885d0a231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6925b22-721e-4066-908d-79885d0a231d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cefa360-4948-44dd-a79a-4997044bfb60', 'volume_name': 'volume-9cefa360-4948-44dd-a79a-4997044bfb60', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:56 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6fc750-7ca6-499d-a304-a4d7b25f6e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6fc750-7ca6-499d-a304-a4d7b25f6e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbc7528-aa08-4908-b7a6-cbbc0887543e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:57 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Volume 9cefa360-4948-44dd-a79a-4997044bfb60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cefa360-4948-44dd-a79a-4997044bfb60', 'volume_size': 1} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1295222577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cefa360-4948-44dd-a79a-4997044bfb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a5ff06af944945a368310619fb9792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:57Z,use_quota=True,user_id='b62225b2a89743069d25fa146ea653ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Creating volume 9cefa360-4948-44dd-a79a-4997044bfb60 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:57 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.580s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Deleted volume successfully. Sep 30 10:42:57 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 1073741824 Sep 30 10:42:57 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-7dfbc411-170a-4bd2-bbc6-0f4e76da1719 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-84669591-ebe1-4815-b21f-cf5266c8b72e-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:57 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f" returned: 0 in 0.514s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:57 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f Sep 30 10:42:57 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:57 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f" returned: 0 in 0.336s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f" released by "delete_volume" :: held 0.924s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:57 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 1073741824" returned: 0 in 0.643s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Created reservations ['27b7456c-48a0-4c44-8de7-f10cd694abb9', '7bfca410-80d2-4caf-9da5-99b18de0fd11', 'f1701808-6f70-4f45-a06c-34ccc0e6b43b', 'ca245d2f-2594-42b1-bced-6c792b5f1a42'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:42:57 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 Sep 30 10:42:57 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:57 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:42:57 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:58 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60" returned: 0 in 0.351s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbc7528-aa08-4908-b7a6-cbbc0887543e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cefa360-4948-44dd-a79a-4997044bfb60', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a66309-6874-46b7-a42b-80aef64ac8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:58 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Volume volume-9cefa360-4948-44dd-a79a-4997044bfb60 (9cefa360-4948-44dd-a79a-4997044bfb60): created successfully Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a66309-6874-46b7-a42b-80aef64ac8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Flow 'volume_create_manager' (e221f73f-7712-48ce-94f7-54d62c63003b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-73931923-4991-431f-b7a8-63c6a7eeebce tempest-VolumeDependencyTests-1785597029 None] Created volume successfully. Sep 30 10:42:58 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.266s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:42:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Deleted volume successfully. Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a64531f0-b46c-46cf-b20d-46e6057df20b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-5e2a8179-5af3-4702-bcd4-aa4183c1cb0f-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-1208baae-ffcf-4d55-8259-d4ef0230963d-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-1208baae-ffcf-4d55-8259-d4ef0230963d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-quobyte-1208baae-ffcf-4d55-8259-d4ef0230963d" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-1208baae-ffcf-4d55-8259-d4ef0230963d" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[985c0791-4959-447b-ad2d-5a80eca6519c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:42:59 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d Sep 30 10:42:59 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Flow 'volume_create_manager' (1ead25f8-37ee-4d07-93ea-dc3969a2be49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24981f54-9b6c-4c29-83e3-c6370717f9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24981f54-9b6c-4c29-83e3-c6370717f9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432186928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3724a3a581154aa1b80f0dd827015cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:59Z,use_quota=True,user_id='51c4c9df27cd4822a805c86564998064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:59 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 1073741824 Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce935c4-eb42-4488-8dee-772bfda1b3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce935c4-eb42-4488-8dee-772bfda1b3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cd0112-5214-45b5-a8ff-76560b25933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cd0112-5214-45b5-a8ff-76560b25933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3', 'volume_name': 'volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac051cf7-e0c6-4cb6-a316-0b4eca4e29fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac051cf7-e0c6-4cb6-a316-0b4eca4e29fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ee2a00-b7c0-40a2-87c6-d1a6dbf6a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:42:59 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Volume 7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3', 'volume_size': 1} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:59 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432186928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3724a3a581154aa1b80f0dd827015cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:42:59Z,use_quota=True,user_id='51c4c9df27cd4822a805c86564998064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Creating volume 7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:42:59 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:42:59 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d" returned: 0 in 0.524s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:59 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d Sep 30 10:42:59 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:59 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 1073741824" returned: 0 in 0.538s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:42:59 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1208baae-ffcf-4d55-8259-d4ef0230963d" returned: 0 in 0.331s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:42:59 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 Sep 30 10:42:59 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:42:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-1208baae-ffcf-4d55-8259-d4ef0230963d" released by "delete_volume" :: held 0.923s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Created reservations ['a59ce59d-3e8c-4415-82cc-f7b0bfda87f9', '2d332f45-98bf-4a3a-905c-17f89e3fc259', '9edb6572-729e-408e-92ca-6fea3de8f1af', '23c48797-4bdb-47cc-a7eb-b5ef135bdeb1'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:00 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:00 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:00 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3" returned: 0 in 0.298s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.829s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ee2a00-b7c0-40a2-87c6-d1a6dbf6a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fa94ea-34aa-4dd4-9db7-0adf65a2b49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Creating offline snapshot 07283d51-cc1d-4b92-852f-f1ce3b701c95 of volume 9cefa360-4948-44dd-a79a-4997044bfb60 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:43:00 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Volume volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 (7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3): created successfully Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fa94ea-34aa-4dd4-9db7-0adf65a2b49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Flow 'volume_create_manager' (1ead25f8-37ee-4d07-93ea-dc3969a2be49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b87638e-29b9-4c20-9725-48d2f7238264]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b3c6f522-8d68-499b-9bd4-2381b1e5ced9 tempest-ProjectReaderTests-1601748428 None] Created volume successfully. Sep 30 10:43:00 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:00 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 Sep 30 10:43:00 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.352s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Deleted volume successfully. Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-07f40f11-5643-45fc-bcbe-8b67dd39d62b tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-1208baae-ffcf-4d55-8259-d4ef0230963d-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Flow 'volume_create_manager' (ac6bf1fd-eb7f-468f-bd18-2c160443520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7310c8-faf8-46d0-b20d-0692c7184a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7310c8-faf8-46d0-b20d-0692c7184a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888729980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca3c224-9fd8-47d6-bc04-a983d89cae37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51048571c2014127a8fe81716d0f54a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:01Z,use_quota=True,user_id='8faa299a205b43419b67ca7d7b29fe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2181590-dd30-4c5f-b692-a9bbe8b2ea0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2181590-dd30-4c5f-b692-a9bbe8b2ea0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f504ee28-3bc6-479d-9797-a623c4032050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f504ee28-3bc6-479d-9797-a623c4032050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca3c224-9fd8-47d6-bc04-a983d89cae37', 'volume_name': 'volume-bca3c224-9fd8-47d6-bc04-a983d89cae37', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f18636b-e12e-4e22-a4fd-48b14b5c3d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f18636b-e12e-4e22-a4fd-48b14b5c3d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d6ad3b-a848-4dc8-b122-eba4db1f6771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:00 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Volume bca3c224-9fd8-47d6-bc04-a983d89cae37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca3c224-9fd8-47d6-bc04-a983d89cae37', 'volume_size': 1} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:00 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60" returned: 0 in 0.433s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:00 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 1G Sep 30 10:43:00 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:01 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 1G" returned: 0 in 0.386s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cefa360-4948-44dd-a79a-4997044bfb60 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:01 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cefa360-4948-44dd-a79a-4997044bfb60 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 Sep 30 10:43:01 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-90eb33b6-9a7f-4975-9536-125ff6b2decb-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-90eb33b6-9a7f-4975-9536-125ff6b2decb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-quobyte-90eb33b6-9a7f-4975-9536-125ff6b2decb" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-90eb33b6-9a7f-4975-9536-125ff6b2decb" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[379e1754-b97c-4a71-9896-9afee983fb85]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:01 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb Sep 30 10:43:01 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Acquiring lock "cinder-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Lock "cinder-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:01 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cefa360-4948-44dd-a79a-4997044bfb60 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95" returned: 0 in 0.402s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:01 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 is being set with open permissions: ugo+rw Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:01 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Acquiring lock "cinder-quobyte-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:01 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Lock "cinder-quobyte-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1130a270-eb08-40f0-9534-e0cf71c77e72]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:01 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb" returned: 0 in 0.400s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:01 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 Sep 30 10:43:01 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:01 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb Sep 30 10:43:01 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:01 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95" returned: 0 in 0.264s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:01 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.info Sep 30 10:43:01 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:01 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-90eb33b6-9a7f-4975-9536-125ff6b2decb" returned: 0 in 0.265s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:01 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-90eb33b6-9a7f-4975-9536-125ff6b2decb" released by "delete_volume" :: held 0.721s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:02 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3" returned: 0 in 0.394s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:02 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3 Sep 30 10:43:02 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Created reservations ['4ed46b75-c774-4eca-9ab3-6b7d93308b85', '9b94713d-e9b1-4ee4-8bfe-189903879ad2', 'd3b273b3-604a-48a8-adae-366b1462cfd8', '6ae302d6-5320-42e8-ae58-586502a33037'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:02 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.info" returned: 0 in 0.271s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:02 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.info is being set with open permissions: ugo+rw Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:02 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.info Sep 30 10:43:02 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:02 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:02 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:02 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3" returned: 0 in 0.274s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Lock "cinder-quobyte-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3" released by "delete_volume" :: held 0.712s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Created reservations ['eec43db0-1365-4710-af28-5fe1fb490212', '4a260e56-5251-49fe-acd4-f275031096ad', 'c029a309-3467-4b72-aef9-4f8df5f87d94', '8f4e67ae-7023-46cd-b8e4-ed9dcf6f8358'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:02 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-8b54f4ca-224f-4783-900f-9ff24ed42254-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.info" returned: 0 in 0.286s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.750s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888729980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca3c224-9fd8-47d6-bc04-a983d89cae37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51048571c2014127a8fe81716d0f54a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:01Z,use_quota=True,user_id='8faa299a205b43419b67ca7d7b29fe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Creating volume bca3c224-9fd8-47d6-bc04-a983d89cae37 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:02 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:02 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:02 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 1073741824 Sep 30 10:43:02 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-8b54f4ca-224f-4783-900f-9ff24ed42254-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-quobyte-c2abd5c4-7617-4600-8047-c3ea3f21176e" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.317s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:02 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Deleted volume successfully. Sep 30 10:43:02 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-09e7fad2-2c70-47de-a3b2-799d080686e7 tempest-VolumeDependencyTests-1785597029 None] Create snapshot completed successfully Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-c2abd5c4-7617-4600-8047-c3ea3f21176e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-quobyte-8b54f4ca-224f-4783-900f-9ff24ed42254" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a194b56c-02f9-4b66-8f74-36e24e1907c7 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-90eb33b6-9a7f-4975-9536-125ff6b2decb-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-8b54f4ca-224f-4783-900f-9ff24ed42254" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Deleting offline snapshot 8b54f4ca-224f-4783-900f-9ff24ed42254 of volume c2abd5c4-7617-4600-8047-c3ea3f21176e {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] snapshot_file for this snap is: volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ed6a30-89d8-45e7-9c46-5bfe65ed0f98]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:02 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:02 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:02 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 Sep 30 10:43:02 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:02 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.294s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:02 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Deleted volume successfully. Sep 30 10:43:02 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 1073741824" returned: 0 in 0.528s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aa3f95e5-59b1-4753-bba8-3bde315511cc tempest-ProjectReaderTests-1601748428 None] Lock "cinder-7992e0b9-8e9f-46f0-a206-c4c1f68b4eb3-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:03 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 Sep 30 10:43:03 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:03 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254" returned: 0 in 0.451s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2abd5c4-7617-4600-8047-c3ea3f21176e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2813d645-1ad8-47ff-aa11-15dc19f480d7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:03 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e Sep 30 10:43:03 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Flow 'volume_create_manager' (37ab8600-728e-4a1e-baea-e6fe28cbf1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c4cec3-54a5-4b5b-992e-2e4f86d077b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:03 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37" returned: 0 in 0.252s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c4cec3-54a5-4b5b-992e-2e4f86d077b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454268935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc97d144-6ecb-42b2-a352-0c2d2ace5ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3724a3a581154aa1b80f0dd827015cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:03Z,use_quota=True,user_id='51c4c9df27cd4822a805c86564998064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8675208-dcb3-4d87-b64a-43db3d50ccaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8675208-dcb3-4d87-b64a-43db3d50ccaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aeb325b-18fa-4302-9fd8-058279b193e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aeb325b-18fa-4302-9fd8-058279b193e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc97d144-6ecb-42b2-a352-0c2d2ace5ebb', 'volume_name': 'volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc40b3cc-834d-4786-8c5e-b169946d00f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc40b3cc-834d-4786-8c5e-b169946d00f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c13c14c-49bb-4da6-8cc8-9b7a0d803608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:03 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Volume fc97d144-6ecb-42b2-a352-0c2d2ace5ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb', 'volume_size': 1} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454268935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc97d144-6ecb-42b2-a352-0c2d2ace5ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3724a3a581154aa1b80f0dd827015cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:03Z,use_quota=True,user_id='51c4c9df27cd4822a805c86564998064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Creating volume fc97d144-6ecb-42b2-a352-0c2d2ace5ebb {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:03 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d6ad3b-a848-4dc8-b122-eba4db1f6771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca3c224-9fd8-47d6-bc04-a983d89cae37', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627b7fd4-36f8-404e-9473-ac7541b965a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:03 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb 1073741824 Sep 30 10:43:03 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:03 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Volume volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 (bca3c224-9fd8-47d6-bc04-a983d89cae37): created successfully Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627b7fd4-36f8-404e-9473-ac7541b965a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Flow 'volume_create_manager' (ac6bf1fd-eb7f-468f-bd18-2c160443520c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:03 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-6068bb81-0c3c-4839-b0aa-8bc5ae13e466 tempest-ProjectReaderTests-458189389 None] Created volume successfully. Sep 30 10:43:03 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e" returned: 0 in 0.401s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:03 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 Sep 30 10:43:03 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:03 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb 1073741824" returned: 0 in 0.539s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:03 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254" returned: 0 in 0.435s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:03 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb Sep 30 10:43:03 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:03 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254 Sep 30 10:43:04 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:04 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:04 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb" returned: 0 in 0.364s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e.8b54f4ca-224f-4783-900f-9ff24ed42254" returned: 0 in 0.356s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c13c14c-49bb-4da6-8cc8-9b7a0d803608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eecd5c0-c4e9-40e8-ace7-217d1118774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:04 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Volume volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb (fc97d144-6ecb-42b2-a352-0c2d2ace5ebb): created successfully Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eecd5c0-c4e9-40e8-ace7-217d1118774d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Flow 'volume_create_manager' (37ab8600-728e-4a1e-baea-e6fe28cbf1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Flow 'volume_create_manager' (ac15ea59-2b85-4773-b7da-64561a1a8c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38074b01-11bc-4237-bad4-e0302417d7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:04 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-5309e84d-1d66-4d39-9332-609fc789529b tempest-ProjectReaderTests-1601748428 None] Created volume successfully. Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Creating offline snapshot 8e7a30e3-6cc7-4113-afa3-201d1b973ec2 of volume bca3c224-9fd8-47d6-bc04-a983d89cae37 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-8b54f4ca-224f-4783-900f-9ff24ed42254" released by "_delete_snapshot" :: held 1.971s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38074b01-11bc-4237-bad4-e0302417d7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1889751786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bf4b6b-1a54-4295-a7b9-112e06b48ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a5ff06af944945a368310619fb9792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07283d51-cc1d-4b92-852f-f1ce3b701c95,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:04Z,use_quota=True,user_id='b62225b2a89743069d25fa146ea653ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf37f67-7cd3-46ed-ab69-fae359e5436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf37f67-7cd3-46ed-ab69-fae359e5436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bef8ef-1636-48b3-b64d-f641fbfbf910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bef8ef-1636-48b3-b64d-f641fbfbf910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2bf4b6b-1a54-4295-a7b9-112e06b48ea9', 'volume_name': 'volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9', 'volume_size': 1, 'snapshot_id': '07283d51-cc1d-4b92-852f-f1ce3b701c95'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7277f7c4-9c18-4d2e-bbd3-c09f794ac126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7277f7c4-9c18-4d2e-bbd3-c09f794ac126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab3ccb7-4968-40e5-b0b0-ef6acea1ea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:04 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Volume c2bf4b6b-1a54-4295-a7b9-112e06b48ea9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9', 'volume_size': 1, 'snapshot_id': '07283d51-cc1d-4b92-852f-f1ce3b701c95'} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-c2abd5c4-7617-4600-8047-c3ea3f21176e" released by "delete_snapshot" :: held 2.053s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e368f1b9-cddc-4536-8fd6-18294594db2f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Created reservations ['a4408b02-d087-493b-947e-65b09a436430', 'cacc6ea7-f92e-4013-90b7-f0d1e8990411', '755624ca-69c2-4ed4-8240-4fc23c2e19b5', 'f120965a-6e31-4edf-96e1-b6b9aff6c5cc'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:04 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 Sep 30 10:43:04 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:04 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Delete snapshot completed successfully. Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-de598e18-f3ac-4303-b771-d161f01b9fa1 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-8b54f4ca-224f-4783-900f-9ff24ed42254-delete_snapshot" released by "delete_snapshot" :: held 2.239s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:04 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37" returned: 0 in 0.369s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:04 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 1G Sep 30 10:43:04 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Acquiring lock "cinder-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:05 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 1G" returned: 0 in 0.409s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Lock "cinder-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:05 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 Sep 30 10:43:05 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Acquiring lock "cinder-quobyte-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Lock "cinder-quobyte-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[46697453-a7a9-4730-8c58-3f9029d429c4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:05 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb Sep 30 10:43:05 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-c2abd5c4-7617-4600-8047-c3ea3f21176e-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-c2abd5c4-7617-4600-8047-c3ea3f21176e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "cinder-quobyte-c2abd5c4-7617-4600-8047-c3ea3f21176e" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-c2abd5c4-7617-4600-8047-c3ea3f21176e" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:05 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2" returned: 0 in 0.382s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:05 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 is being set with open permissions: ugo+rw Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f35a6c8-d499-4a3a-8d67-ffa7c1167f42]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:05 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 Sep 30 10:43:05 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:05 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e Sep 30 10:43:05 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:05 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb" returned: 0 in 0.421s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:05 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb Sep 30 10:43:05 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:05 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2" returned: 0 in 0.265s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:06 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.info Sep 30 10:43:06 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:06 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb" returned: 0 in 0.282s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:06 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e" returned: 0 in 0.431s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Lock "cinder-quobyte-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb" released by "delete_volume" :: held 0.763s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:06 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e Sep 30 10:43:06 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Created reservations ['7b27bf2a-6536-4152-b9ed-80d653046fb3', '64df24a4-73a8-4355-bb0d-0f7d16a2122d', '4b47692b-7966-4643-acf0-619b7c7b9444', '26739566-63f2-404b-bb22-2099295dd70f'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:06 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.info" returned: 0 in 0.314s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:06 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.info is being set with open permissions: ugo+rw Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:06 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:06 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:06 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.info Sep 30 10:43:06 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:06 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2abd5c4-7617-4600-8047-c3ea3f21176e" returned: 0 in 0.280s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-quobyte-c2abd5c4-7617-4600-8047-c3ea3f21176e" released by "delete_volume" :: held 0.801s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Created reservations ['f86ee9cf-618a-4bad-8d8b-81b09f8a5a4d', '9240926d-ca05-4c0a-b91f-e748a41db98d', 'c8dcd087-3618-4be8-880c-8cbb0c9d2fcb', '51a30c42-f7f7-4333-bd39-ca0770336ec6'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:06 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.302s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:06 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Deleted volume successfully. Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.info" returned: 0 in 0.333s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:06 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:06 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.105s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "cinder-quobyte-07283d51-cc1d-4b92-852f-f1ce3b701c95-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" by "_create_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-07283d51-cc1d-4b92-852f-f1ce3b701c95-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Creating volume c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 from snapshot 07283d51-cc1d-4b92-852f-f1ce3b701c95 {{(pid=87013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "cinder-quobyte-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-01cfa4f9-6586-4a59-8d01-34ab19b23e34 tempest-ProjectReaderTests-1601748428 None] Lock "cinder-fc97d144-6ecb-42b2-a352-0c2d2ace5ebb-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3a87ff11-5f42-4c5a-a319-4ea93678b25d tempest-ProjectReaderTests-458189389 None] Create snapshot completed successfully Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] snapshot: 07283d51-cc1d-4b92-852f-f1ce3b701c95, volume: c2bf4b6b-1a54-4295-a7b9-112e06b48ea9, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d1a79f-b306-4fac-9eaa-19dc8f50582e]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:06 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.320s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:06 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Deleted volume successfully. Sep 30 10:43:06 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 Sep 30 10:43:06 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0deacbc4-0519-4eb8-a2ae-d64d00cdae62 tempest-CreateVolumesFromSnapshotTest-463546422 None] Lock "cinder-c2abd5c4-7617-4600-8047-c3ea3f21176e-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:07 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95" returned: 0 in 0.470s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cefa360-4948-44dd-a79a-4997044bfb60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[814e4d44-e4be-4613-8c22-964cef481acc]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:07 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 Sep 30 10:43:07 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-8e7a30e3-6cc7-4113-afa3-201d1b973ec2-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Lock "cinder-8e7a30e3-6cc7-4113-afa3-201d1b973ec2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-bca3c224-9fd8-47d6-bc04-a983d89cae37" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-bca3c224-9fd8-47d6-bc04-a983d89cae37" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-8e7a30e3-6cc7-4113-afa3-201d1b973ec2" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-8e7a30e3-6cc7-4113-afa3-201d1b973ec2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Deleting offline snapshot 8e7a30e3-6cc7-4113-afa3-201d1b973ec2 of volume bca3c224-9fd8-47d6-bc04-a983d89cae37 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] snapshot_file for this snap is: volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad01dcdf-5866-4faa-bf5b-0d1e8a357124]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:07 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 Sep 30 10:43:07 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:07 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60" returned: 0 in 0.627s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:43:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:08 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 Sep 30 10:43:08 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:08 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2" returned: 0 in 0.474s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca3c224-9fd8-47d6-bc04-a983d89cae37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:43:08 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1494fb8-1ec5-4191-8009-c0c0e7920f4a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:08 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 Sep 30 10:43:08 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:08 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37" returned: 0 in 0.638s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:08 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 Sep 30 10:43:08 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:09 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2" returned: 0 in 0.859s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:09 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2 Sep 30 10:43:09 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:10 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37.8e7a30e3-6cc7-4113-afa3-201d1b973ec2" returned: 0 in 0.512s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-8e7a30e3-6cc7-4113-afa3-201d1b973ec2" released by "_delete_snapshot" :: held 2.659s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-bca3c224-9fd8-47d6-bc04-a983d89cae37" released by "delete_snapshot" :: held 2.693s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:10 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Created reservations ['d8c8a596-af75-45ff-ac7f-643c1d085d84', 'c02f5d5c-e127-4add-a540-81dc51b0b9ce', '5477b6d5-8cb1-4626-a3e7-8072bd7a99a4', 'faa774a2-aed3-45f8-9124-058967e24de0'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:10 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Delete snapshot completed successfully. Sep 30 10:43:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a2b836a1-364e-4ff5-9270-b546ce586c87 tempest-ProjectReaderTests-458189389 None] Lock "cinder-8e7a30e3-6cc7-4113-afa3-201d1b973ec2-delete_snapshot" released by "delete_snapshot" :: held 2.997s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-bca3c224-9fd8-47d6-bc04-a983d89cae37-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Lock "cinder-bca3c224-9fd8-47d6-bc04-a983d89cae37-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-bca3c224-9fd8-47d6-bc04-a983d89cae37" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-bca3c224-9fd8-47d6-bc04-a983d89cae37" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:11 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de9a921-bf51-4880-a97c-1eebe25d0e19]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:11 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 Sep 30 10:43:11 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:12 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37" returned: 0 in 0.902s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:12 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37 Sep 30 10:43:12 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:12 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-bca3c224-9fd8-47d6-bc04-a983d89cae37" returned: 0 in 0.555s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-bca3c224-9fd8-47d6-bc04-a983d89cae37" released by "delete_volume" :: held 1.676s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Created reservations ['3bab57c4-4b32-4353-99b7-fde85558bd11', '04d3c05b-7481-415d-a45e-9b139a7dbf28', '3485df7b-a19d-4e53-98fa-1462f04a194e', 'e3acdc30-e5dd-47e8-af93-00e242991530'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:13 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:13 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:13 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.654s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:13 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Deleted volume successfully. Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (ccc10c6e-e75e-4d23-93f6-5f2ee48dcf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5ad609-a823-4878-9f08-a26f8cdd721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5ad609-a823-4878-9f08-a26f8cdd721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1665461588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a350d0-9545-45e4-8aa1-2f706279bf44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:14Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f03ac39-6140-4e3f-8a93-c48cbf1e0932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f03ac39-6140-4e3f-8a93-c48cbf1e0932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31eef5e5-3130-4b4d-922d-fc3450440219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31eef5e5-3130-4b4d-922d-fc3450440219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a350d0-9545-45e4-8aa1-2f706279bf44', 'volume_name': 'volume-02a350d0-9545-45e4-8aa1-2f706279bf44', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0397f86-50a3-49e0-872e-1f487076c9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0397f86-50a3-49e0-872e-1f487076c9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d346cd-4f3e-4368-b8bd-4dd3a1600c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:14 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume 02a350d0-9545-45e4-8aa1-2f706279bf44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a350d0-9545-45e4-8aa1-2f706279bf44', 'volume_size': 1} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9fb2300a-0655-48b9-82f1-8ef9389af72a tempest-ProjectReaderTests-458189389 None] Lock "cinder-bca3c224-9fd8-47d6-bc04-a983d89cae37-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Flow 'volume_create_manager' (ba2f72b5-0de8-469c-9965-f5ea18174aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dca8c92-f357-499d-93f2-e811ab245f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dca8c92-f357-499d-93f2-e811ab245f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316245872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62a1339-cf27-4f08-9650-907a9f500e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51048571c2014127a8fe81716d0f54a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:14Z,use_quota=True,user_id='8faa299a205b43419b67ca7d7b29fe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fbd40b-022a-4cc8-9252-e2ed77660bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fbd40b-022a-4cc8-9252-e2ed77660bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d269ecd-9564-47b5-b2eb-bd98e5415699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d269ecd-9564-47b5-b2eb-bd98e5415699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62a1339-cf27-4f08-9650-907a9f500e11', 'volume_name': 'volume-c62a1339-cf27-4f08-9650-907a9f500e11', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17191b88-5528-494e-88ce-ad2183117953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17191b88-5528-494e-88ce-ad2183117953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c780b4fe-ccca-46c8-af94-c335153d4e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:14 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Volume c62a1339-cf27-4f08-9650-907a9f500e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62a1339-cf27-4f08-9650-907a9f500e11', 'volume_size': 1} Sep 30 10:43:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:16 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" returned: 0 in 8.631s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:43:16 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Converted 1024.00 MB image at 118.62 MB/s Sep 30 10:43:16 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 is being set with open permissions: ugo+rw Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:16 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 Sep 30 10:43:16 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:16 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" returned: 0 in 0.271s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" released by "_copy_volume_from_snapshot" :: held 10.107s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-07283d51-cc1d-4b92-852f-f1ce3b701c95-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" released by "_create_volume_from_snapshot" :: held 10.189s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.235s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.842s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1665461588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a350d0-9545-45e4-8aa1-2f706279bf44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:14Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Creating volume 02a350d0-9545-45e4-8aa1-2f706279bf44 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:16 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:16 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44 1073741824 Sep 30 10:43:16 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab3ccb7-4968-40e5-b0b0-ef6acea1ea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9', 'volume_size': 1, 'snapshot_id': '07283d51-cc1d-4b92-852f-f1ce3b701c95'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebdabce-1d92-4691-999b-1bcf2f8f4f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:17 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Volume volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 (c2bf4b6b-1a54-4295-a7b9-112e06b48ea9): created successfully Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebdabce-1d92-4691-999b-1bcf2f8f4f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Flow 'volume_create_manager' (ac15ea59-2b85-4773-b7da-64561a1a8c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:17 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-85303c27-9270-4c52-9176-d8f4a26beea2 tempest-VolumeDependencyTests-1785597029 None] Created volume successfully. Sep 30 10:43:17 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44 1073741824" returned: 0 in 0.486s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "cinder-07283d51-cc1d-4b92-852f-f1ce3b701c95-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-07283d51-cc1d-4b92-852f-f1ce3b701c95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "cinder-quobyte-9cefa360-4948-44dd-a79a-4997044bfb60" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:17 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44 Sep 30 10:43:17 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-9cefa360-4948-44dd-a79a-4997044bfb60" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "cinder-quobyte-07283d51-cc1d-4b92-852f-f1ce3b701c95" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-07283d51-cc1d-4b92-852f-f1ce3b701c95" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Deleting offline snapshot 07283d51-cc1d-4b92-852f-f1ce3b701c95 of volume 9cefa360-4948-44dd-a79a-4997044bfb60 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] snapshot_file for this snap is: volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7555c9-ad69-4060-9863-e2a5ec7a1379]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:17 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 Sep 30 10:43:17 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:17 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44" returned: 0 in 0.303s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.157s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316245872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62a1339-cf27-4f08-9650-907a9f500e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51048571c2014127a8fe81716d0f54a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:14Z,use_quota=True,user_id='8faa299a205b43419b67ca7d7b29fe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Creating volume c62a1339-cf27-4f08-9650-907a9f500e11 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:17 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:17 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 1073741824 Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d346cd-4f3e-4368-b8bd-4dd3a1600c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a350d0-9545-45e4-8aa1-2f706279bf44', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:17 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3746836f-c65a-42e6-b9ca-f98e43254c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:17 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume volume-02a350d0-9545-45e4-8aa1-2f706279bf44 (02a350d0-9545-45e4-8aa1-2f706279bf44): created successfully Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3746836f-c65a-42e6-b9ca-f98e43254c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (ccc10c6e-e75e-4d23-93f6-5f2ee48dcf57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:17 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7355c9c9-1420-47d1-93d3-34ed1637367d tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created volume successfully. Sep 30 10:43:18 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95" returned: 0 in 0.434s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cefa360-4948-44dd-a79a-4997044bfb60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e162ab-ec0c-429f-8477-06f57d194a54]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:18 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 Sep 30 10:43:18 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:18 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 1073741824" returned: 0 in 0.597s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:18 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 Sep 30 10:43:18 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (3e8ba432-7314-48fe-9884-1fc1e9b726e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cf806a-111b-4b20-ae51-e74ba7331ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cf806a-111b-4b20-ae51-e74ba7331ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593705683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad91f363-ae2c-4c56-b9a5-db95d905ed61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:19Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b91c8a-8b10-41a7-b14d-dd90147532ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b91c8a-8b10-41a7-b14d-dd90147532ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ec2703-d424-42e9-88a0-55bb81e2ada4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ec2703-d424-42e9-88a0-55bb81e2ada4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad91f363-ae2c-4c56-b9a5-db95d905ed61', 'volume_name': 'volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7366453c-8bcd-4689-be21-e687cb3537f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7366453c-8bcd-4689-be21-e687cb3537f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbdcaef-5c8d-43e9-92d7-5cee6ba7164a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:18 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume ad91f363-ae2c-4c56-b9a5-db95d905ed61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61', 'volume_size': 1} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:18 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11" returned: 0 in 0.421s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.174s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593705683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad91f363-ae2c-4c56-b9a5-db95d905ed61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:19Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Creating volume ad91f363-ae2c-4c56-b9a5-db95d905ed61 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:18 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:18 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60" returned: 0 in 0.882s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:18 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61 1073741824 Sep 30 10:43:18 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c780b4fe-ccca-46c8-af94-c335153d4e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62a1339-cf27-4f08-9650-907a9f500e11', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:18 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d015e440-01ff-429c-82bb-9cae55eac0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 Sep 30 10:43:19 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:19 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Volume volume-c62a1339-cf27-4f08-9650-907a9f500e11 (c62a1339-cf27-4f08-9650-907a9f500e11): created successfully Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d015e440-01ff-429c-82bb-9cae55eac0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Flow 'volume_create_manager' (ba2f72b5-0de8-469c-9965-f5ea18174aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:19 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-b6048e9f-b443-4450-ac0d-9cb380b81cf4 tempest-ProjectReaderTests-458189389 None] Created volume successfully. Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (a1705ae5-393c-4e7e-9fac-171158a4ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5cd245-c55c-4cf3-a53f-2bfa774d80c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5cd245-c55c-4cf3-a53f-2bfa774d80c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1157143615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9f1525-1cd3-4533-92f5-330123be1cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:19Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436ae5cf-caea-44d6-bc58-b8adb30cbdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436ae5cf-caea-44d6-bc58-b8adb30cbdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25d349f-ca01-458d-b993-c3e1be7a3711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25d349f-ca01-458d-b993-c3e1be7a3711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa9f1525-1cd3-4533-92f5-330123be1cd0', 'volume_name': 'volume-fa9f1525-1cd3-4533-92f5-330123be1cd0', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f54b9d-f23e-466f-b195-19bcf89f2adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f54b9d-f23e-466f-b195-19bcf89f2adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd17286-33f8-4edc-b8a9-90b4a9ab9192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume fa9f1525-1cd3-4533-92f5-330123be1cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa9f1525-1cd3-4533-92f5-330123be1cd0', 'volume_size': 1} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:19 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95" returned: 0 in 0.449s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:19 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95 Sep 30 10:43:19 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (4cf3586a-f822-489a-b5be-376c6dd78daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f2f153-c0b0-4b5c-a15b-04e42f48f6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f2f153-c0b0-4b5c-a15b-04e42f48f6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759177783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41470c82-d712-404a-9102-20504b3ad763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:19Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1737560c-2d77-4d32-b606-6dbc53add57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1737560c-2d77-4d32-b606-6dbc53add57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10cf3b30-6439-4a0a-958a-58642eddd74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10cf3b30-6439-4a0a-958a-58642eddd74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41470c82-d712-404a-9102-20504b3ad763', 'volume_name': 'volume-41470c82-d712-404a-9102-20504b3ad763', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fa9d78-de90-414c-91f6-3db9301176f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fa9d78-de90-414c-91f6-3db9301176f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6203af-588c-4c97-bd10-d70c506a6b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:19 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume 41470c82-d712-404a-9102-20504b3ad763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41470c82-d712-404a-9102-20504b3ad763', 'volume_size': 1} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:19 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61 1073741824" returned: 0 in 0.705s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:19 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61 Sep 30 10:43:19 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:19 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60.07283d51-cc1d-4b92-852f-f1ce3b701c95" returned: 0 in 0.391s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-07283d51-cc1d-4b92-852f-f1ce3b701c95" released by "_delete_snapshot" :: held 2.321s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:19 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-9cefa360-4948-44dd-a79a-4997044bfb60" released by "delete_snapshot" :: held 2.359s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (061040e5-8d2e-43cc-9357-e748a7e3c84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5831e502-2598-4f31-8355-f4fb7b528634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61" returned: 0 in 0.476s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Created reservations ['46d7174b-d08d-4ee0-823e-109440d8da03', '2fb4073d-e284-45d9-ad58-41b8c6244562', '3ea4d01a-280c-45b5-a569-2d29337a45ea', '01889d5c-56c9-40c5-b2c3-31334fdd81dd'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5831e502-2598-4f31-8355-f4fb7b528634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2104724802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c43130-dbff-498b-a06f-85f9fc2527f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:20Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff6914b-341f-43d3-842a-f437117b260b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff6914b-341f-43d3-842a-f437117b260b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6502e2-f541-46a8-9c8c-e2a35387b206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6502e2-f541-46a8-9c8c-e2a35387b206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c43130-dbff-498b-a06f-85f9fc2527f4', 'volume_name': 'volume-30c43130-dbff-498b-a06f-85f9fc2527f4', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b69c3b-361a-434d-b41b-badc16428232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b69c3b-361a-434d-b41b-badc16428232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad58bcd1-0fa5-460e-affc-47c81228b0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume 30c43130-dbff-498b-a06f-85f9fc2527f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c43130-dbff-498b-a06f-85f9fc2527f4', 'volume_size': 1} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2104724802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c43130-dbff-498b-a06f-85f9fc2527f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:20Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Creating volume 30c43130-dbff-498b-a06f-85f9fc2527f4 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:20 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:20 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4 1073741824 Sep 30 10:43:20 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbdcaef-5c8d-43e9-92d7-5cee6ba7164a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30883e59-a373-46d2-b5cd-c219f52ce874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61 (ad91f363-ae2c-4c56-b9a5-db95d905ed61): created successfully Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30883e59-a373-46d2-b5cd-c219f52ce874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (3e8ba432-7314-48fe-9884-1fc1e9b726e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-145a059d-3b19-4989-bad1-295bea47c2a6 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created volume successfully. Sep 30 10:43:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Delete snapshot completed successfully. Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5f24c8e7-6688-42ec-a771-981e6b05be1b tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-07283d51-cc1d-4b92-852f-f1ce3b701c95-delete_snapshot" released by "delete_snapshot" :: held 2.894s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (d5a4fa97-fdc3-41a5-b9a5-7831445c34f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2793a8de-252d-4bd2-8d74-2a0142104c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2793a8de-252d-4bd2-8d74-2a0142104c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118408330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4190449-3dfc-4361-8ee6-6b676d5c49b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:21Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e5e02a-21e9-4bd9-90cb-14403f0835bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e5e02a-21e9-4bd9-90cb-14403f0835bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65798638-5b3b-44c7-ae20-47d24837823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65798638-5b3b-44c7-ae20-47d24837823c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4190449-3dfc-4361-8ee6-6b676d5c49b2', 'volume_name': 'volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b23646b-d908-459b-97da-ffff60cc564d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b23646b-d908-459b-97da-ffff60cc564d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22336716-9c66-48e6-987c-deb8512ddacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:20 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume c4190449-3dfc-4361-8ee6-6b676d5c49b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2', 'volume_size': 1} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:20 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4 1073741824" returned: 0 in 0.635s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "cinder-9cefa360-4948-44dd-a79a-4997044bfb60-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:20 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4 Sep 30 10:43:20 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-9cefa360-4948-44dd-a79a-4997044bfb60-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "cinder-quobyte-9cefa360-4948-44dd-a79a-4997044bfb60" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:20 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-9cefa360-4948-44dd-a79a-4997044bfb60" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[87791f31-ee0b-42c9-b2a4-fcc285b42582]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:21 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 Sep 30 10:43:21 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:21 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4" returned: 0 in 0.304s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.601s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759177783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41470c82-d712-404a-9102-20504b3ad763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:19Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Creating volume 41470c82-d712-404a-9102-20504b3ad763 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:21 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad58bcd1-0fa5-460e-affc-47c81228b0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c43130-dbff-498b-a06f-85f9fc2527f4', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f882f4e-e5f7-4f01-898c-cc1ba9c51261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:21 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763 1073741824 Sep 30 10:43:21 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:21 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume volume-30c43130-dbff-498b-a06f-85f9fc2527f4 (30c43130-dbff-498b-a06f-85f9fc2527f4): created successfully Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f882f4e-e5f7-4f01-898c-cc1ba9c51261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (061040e5-8d2e-43cc-9357-e748a7e3c84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:21 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8a0e407a-d8d6-4b7c-a3c6-4fa463e4960b tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created volume successfully. Sep 30 10:43:21 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60" returned: 0 in 0.406s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:21 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60 Sep 30 10:43:21 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:21 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9cefa360-4948-44dd-a79a-4997044bfb60" returned: 0 in 0.320s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:21 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763 1073741824" returned: 0 in 0.582s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-9cefa360-4948-44dd-a79a-4997044bfb60" released by "delete_volume" :: held 0.806s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:21 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763 Sep 30 10:43:21 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Created reservations ['8cf69931-7414-40c2-82b9-65036608e1c1', 'cf668032-3657-4ae3-b2d0-9cd707fa97ac', '1e05764a-373a-4657-9cc8-1c22dcf0ffa2', '6549f5f0-aaeb-4877-bc13-763a5cca9d98'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:21 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:21 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "cinder-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:22 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763" returned: 0 in 0.309s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.887s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1157143615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9f1525-1cd3-4533-92f5-330123be1cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:19Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Creating volume fa9f1525-1cd3-4533-92f5-330123be1cd0 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:22 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:22 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0 1073741824 Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6203af-588c-4c97-bd10-d70c506a6b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41470c82-d712-404a-9102-20504b3ad763', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:22 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2817c3bc-64e9-49f3-aed1-9452db023271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:22 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume volume-41470c82-d712-404a-9102-20504b3ad763 (41470c82-d712-404a-9102-20504b3ad763): created successfully Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2817c3bc-64e9-49f3-aed1-9452db023271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (4cf3586a-f822-489a-b5be-376c6dd78daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:22 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-6a60187b-6a49-48b3-ab25-0750c03bfca7 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created volume successfully. Sep 30 10:43:22 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "cinder-quobyte-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.329s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:22 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Deleted volume successfully. Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" acquired by "delete_volume" :: waited 0.034s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-6daad205-8a65-4fe4-b452-3397ee40a2db tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-9cefa360-4948-44dd-a79a-4997044bfb60-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdf32f3-553d-404d-8a56-ec32f18fe96d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:22 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 Sep 30 10:43:22 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:22 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0 1073741824" returned: 0 in 0.541s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:22 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0 Sep 30 10:43:22 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:22 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" returned: 0 in 0.442s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:22 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9 Sep 30 10:43:22 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:23 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0" returned: 0 in 0.279s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118408330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4190449-3dfc-4361-8ee6-6b676d5c49b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04a37d26a42e884be9c9ed941288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:21Z,use_quota=True,user_id='c540f4f9b4fa46a5b1516200df02dcf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Creating volume c4190449-3dfc-4361-8ee6-6b676d5c49b2 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:23 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:23 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd17286-33f8-4edc-b8a9-90b4a9ab9192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9f1525-1cd3-4533-92f5-330123be1cd0', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50595ce6-7d77-4665-a826-96e1d51f0ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" returned: 0 in 0.287s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:23 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2 1073741824 Sep 30 10:43:23 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-quobyte-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9" released by "delete_volume" :: held 0.792s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:23 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume volume-fa9f1525-1cd3-4533-92f5-330123be1cd0 (fa9f1525-1cd3-4533-92f5-330123be1cd0): created successfully Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50595ce6-7d77-4665-a826-96e1d51f0ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (a1705ae5-393c-4e7e-9fac-171158a4ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:23 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3d5a7438-1887-4539-9612-3d241f23c4c3 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created volume successfully. Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Created reservations ['8a285ab6-80fd-4390-8039-dc987920e810', '089a369b-be37-40fa-930d-990a6137a22e', 'b095a52e-0a0c-4db4-a44e-46e1502ce85e', '2c5159aa-1f72-497d-b7e6-abaa1d9859ba'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:23 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:23 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:23 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2 1073741824" returned: 0 in 0.557s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:23 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.350s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:23 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Deleted volume successfully. Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-45c97cb1-94a5-4856-b4a8-1d1d1df6a535 tempest-VolumeDependencyTests-1785597029 None] Lock "cinder-c2bf4b6b-1a54-4295-a7b9-112e06b48ea9-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:23 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2 Sep 30 10:43:23 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:23 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2" returned: 0 in 0.318s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.160s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22336716-9c66-48e6-987c-deb8512ddacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5248f5a3-407b-4334-ab6c-aba78630ac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Creating offline snapshot ff1a7fdd-b4b0-4d1f-af42-24244589c680 of volume c62a1339-cf27-4f08-9650-907a9f500e11 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:43:24 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Volume volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2 (c4190449-3dfc-4361-8ee6-6b676d5c49b2): created successfully Sep 30 10:43:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5248f5a3-407b-4334-ab6c-aba78630ac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:24 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Flow 'volume_create_manager' (d5a4fa97-fdc3-41a5-b9a5-7831445c34f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:24 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a766db3-44e1-4638-9f75-c53c65440eb6]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:24 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-cef9b604-a4a0-4e97-8b59-ff7180e9e203 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created volume successfully. Sep 30 10:43:24 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 Sep 30 10:43:24 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:24 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11" returned: 0 in 0.460s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:24 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 1G Sep 30 10:43:24 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:25 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 1G" returned: 0 in 0.495s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62a1339-cf27-4f08-9650-907a9f500e11 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:25 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62a1339-cf27-4f08-9650-907a9f500e11 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 Sep 30 10:43:25 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-c4190449-3dfc-4361-8ee6-6b676d5c49b2-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-c4190449-3dfc-4361-8ee6-6b676d5c49b2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-quobyte-c4190449-3dfc-4361-8ee6-6b676d5c49b2" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-c4190449-3dfc-4361-8ee6-6b676d5c49b2" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b63158-e753-4ef9-81a6-6f54cb6cf483]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:25 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62a1339-cf27-4f08-9650-907a9f500e11 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680" returned: 0 in 0.347s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:25 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 is being set with open permissions: ugo+rw Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:25 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 Sep 30 10:43:25 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:25 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2 Sep 30 10:43:25 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:25 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680" returned: 0 in 0.283s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:25 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.info Sep 30 10:43:25 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:25 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2" returned: 0 in 0.402s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:25 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2 Sep 30 10:43:25 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:25 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.info" returned: 0 in 0.271s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:25 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.info is being set with open permissions: ugo+rw Sep 30 10:43:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:26 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.info Sep 30 10:43:26 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:26 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c4190449-3dfc-4361-8ee6-6b676d5c49b2" returned: 0 in 0.264s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-c4190449-3dfc-4361-8ee6-6b676d5c49b2" released by "delete_volume" :: held 0.720s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created reservations ['1ad69ae6-1f1d-45ce-bfd5-11816dabc8d2', '6c15139c-4612-47df-82ea-35da0599388e', 'a947b9ce-ca3d-47d8-8eb0-57d455f1af43', 'a0c5d241-556e-471b-9190-a806f950c269'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:26 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:26 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:26 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.info" returned: 0 in 0.275s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.299s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:26 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-dffe07c9-0ceb-4b00-85cc-b98382b7cb99 tempest-ProjectReaderTests-458189389 None] Create snapshot completed successfully Sep 30 10:43:26 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-30c43130-dbff-498b-a06f-85f9fc2527f4-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.267s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:26 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Deleted volume successfully. Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-30c43130-dbff-498b-a06f-85f9fc2527f4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2db7830f-b7ee-4d41-8ff1-07a1b7e94592 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-c4190449-3dfc-4361-8ee6-6b676d5c49b2-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-quobyte-30c43130-dbff-498b-a06f-85f9fc2527f4" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-30c43130-dbff-498b-a06f-85f9fc2527f4" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1379139e-2cd0-4c1d-b7d4-1e784b23eb90]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:26 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4 Sep 30 10:43:26 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-ff1a7fdd-b4b0-4d1f-af42-24244589c680-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Lock "cinder-ff1a7fdd-b4b0-4d1f-af42-24244589c680-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-c62a1339-cf27-4f08-9650-907a9f500e11" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-c62a1339-cf27-4f08-9650-907a9f500e11" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-ff1a7fdd-b4b0-4d1f-af42-24244589c680" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:26 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-ff1a7fdd-b4b0-4d1f-af42-24244589c680" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Deleting offline snapshot ff1a7fdd-b4b0-4d1f-af42-24244589c680 of volume c62a1339-cf27-4f08-9650-907a9f500e11 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] snapshot_file for this snap is: volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4" returned: 0 in 0.437s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4025dc1c-8a76-45c9-a0e6-8b8e56bc1e9c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:27 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4 Sep 30 10:43:27 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:27 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 Sep 30 10:43:27 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:27 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-30c43130-dbff-498b-a06f-85f9fc2527f4" returned: 0 in 0.263s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-30c43130-dbff-498b-a06f-85f9fc2527f4" released by "delete_volume" :: held 0.762s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created reservations ['7b7aeaf0-7e27-4223-b6eb-1b760d8424de', 'b8d2f389-1e00-46e4-9d4f-04a47271347b', 'f1855924-b4e7-4504-88e7-f2fff2c5b4b3', 'ab1a6c3c-54d2-4f13-93b5-149140770352'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:27 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680" returned: 0 in 0.384s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c62a1339-cf27-4f08-9650-907a9f500e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fa8d27-7f2d-4321-bdfe-a6b0347af2ed]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:27 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:27 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:27 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 Sep 30 10:43:27 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-41470c82-d712-404a-9102-20504b3ad763-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-41470c82-d712-404a-9102-20504b3ad763-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-quobyte-41470c82-d712-404a-9102-20504b3ad763" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:27 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-41470c82-d712-404a-9102-20504b3ad763" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.334s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:27 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Deleted volume successfully. Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e63185-da72-49e4-bc3a-5243529b0f26]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d018d51d-24b2-438c-aa8c-182fe5f0b729 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-30c43130-dbff-498b-a06f-85f9fc2527f4-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:27 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11" returned: 0 in 0.460s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:27 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 Sep 30 10:43:27 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:27 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763 Sep 30 10:43:27 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:28 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763" returned: 0 in 0.392s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:28 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763 Sep 30 10:43:28 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:28 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680" returned: 0 in 0.368s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:28 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680 Sep 30 10:43:28 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:28 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-41470c82-d712-404a-9102-20504b3ad763" returned: 0 in 0.282s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-41470c82-d712-404a-9102-20504b3ad763" released by "delete_volume" :: held 0.731s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:28 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11.ff1a7fdd-b4b0-4d1f-af42-24244589c680" returned: 0 in 0.279s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-ff1a7fdd-b4b0-4d1f-af42-24244589c680" released by "_delete_snapshot" :: held 1.614s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-c62a1339-cf27-4f08-9650-907a9f500e11" released by "delete_snapshot" :: held 1.643s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created reservations ['041f4d97-60d7-4943-9547-bb870dd39825', 'f26c7704-9c70-4b81-9712-4be96c33a5d6', 'cc3bafc0-4a27-4315-9539-d4536188676e', 'd3d8d101-bffa-414f-a642-198a0dac4471'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Created reservations ['859eaeb2-8108-45b8-af9b-b4031a07e640', 'cfcd6a2d-6017-4502-95eb-ec41f2d0e5ce', '7b28542f-c9c6-41fa-9582-85aec7202276', 'efbf66ae-1cb5-40f8-bcc0-6ec7dec7d004'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:28 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:28 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:28 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Delete snapshot completed successfully. Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-e8aedc06-e82e-48b1-a248-271506fde612 tempest-ProjectReaderTests-458189389 None] Lock "cinder-ff1a7fdd-b4b0-4d1f-af42-24244589c680-delete_snapshot" released by "delete_snapshot" :: held 1.852s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-fa9f1525-1cd3-4533-92f5-330123be1cd0-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-fa9f1525-1cd3-4533-92f5-330123be1cd0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-quobyte-fa9f1525-1cd3-4533-92f5-330123be1cd0" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:28 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-fa9f1525-1cd3-4533-92f5-330123be1cd0" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:29 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.279s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:29 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Deleted volume successfully. Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73d29c1-3fe8-432b-928e-b78155ecc080]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0a33468e-7233-43a6-9878-29ab13098e2c tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-41470c82-d712-404a-9102-20504b3ad763-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-c62a1339-cf27-4f08-9650-907a9f500e11-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Lock "cinder-c62a1339-cf27-4f08-9650-907a9f500e11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:29 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0 Sep 30 10:43:29 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-c62a1339-cf27-4f08-9650-907a9f500e11" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-c62a1339-cf27-4f08-9650-907a9f500e11" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[37789244-a6e6-4655-994b-baa9948794ab]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Flow 'volume_create_manager' (36216110-06c3-41cd-b6d9-0b39c3493a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ba3255-ce40-4f34-8892-f159234d2f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ba3255-ce40-4f34-8892-f159234d2f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb62e58a-5464-47de-9a80-1f2cb359c455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14b334e501246c881fdd470bbbfa0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:29Z,use_quota=True,user_id='305b0c8b487e4b8cbf758b2d51dd463b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e1e459-d525-4ff3-9e40-e07ace48e09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e1e459-d525-4ff3-9e40-e07ace48e09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb22ef2-cd56-4652-bdec-a3753ac17bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.image.glance [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Creating Keystone auth plugin from conf {{(pid=87013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 10:43:29 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 Sep 30 10:43:29 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:29 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0" returned: 0 in 0.422s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:29 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0 Sep 30 10:43:29 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb22ef2-cd56-4652-bdec-a3753ac17bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb62e58a-5464-47de-9a80-1f2cb359c455', 'volume_name': 'volume-cb62e58a-5464-47de-9a80-1f2cb359c455', 'volume_size': 1, 'image_id': '289a9587-42f5-43a3-b624-eaed487ef0e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/289a9587-42f5-43a3-b624-eaed487ef0e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f126cf7c6f977cfe19f6497c360da96', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a14b334e501246c881fdd470bbbfa0be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7df92aa6a45a3a743b37e218500831f515e9c797772cb471ad031114b9831caff7b1e51d5fba9a92a95c644ffef1c314efbad85370b4e44fc4b37399bf2e9aea', 'id': '289a9587-42f5-43a3-b624-eaed487ef0e2', 'created_at': datetime.datetime(2026, 9, 30, 8, 43, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 43, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/289a9587-42f5-43a3-b624-eaed487ef0e2/file', 'properties': {}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9072d4eb-33d8-4f90-ab1d-b15ce21e6e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9072d4eb-33d8-4f90-ab1d-b15ce21e6e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c77e30-da2d-498d-92f6-1e5cfd22041c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:29 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Volume cb62e58a-5464-47de-9a80-1f2cb359c455: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb62e58a-5464-47de-9a80-1f2cb359c455', 'volume_size': 1, 'image_id': '289a9587-42f5-43a3-b624-eaed487ef0e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/289a9587-42f5-43a3-b624-eaed487ef0e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f126cf7c6f977cfe19f6497c360da96', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a14b334e501246c881fdd470bbbfa0be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7df92aa6a45a3a743b37e218500831f515e9c797772cb471ad031114b9831caff7b1e51d5fba9a92a95c644ffef1c314efbad85370b4e44fc4b37399bf2e9aea', 'id': '289a9587-42f5-43a3-b624-eaed487ef0e2', 'created_at': datetime.datetime(2026, 9, 30, 8, 43, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 43, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/289a9587-42f5-43a3-b624-eaed487ef0e2/file', 'properties': {}}, 'image_service': } Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Trying to clone cb62e58a-5464-47de-9a80-1f2cb359c455 from image 289a9587-42f5-43a3-b624-eaed487ef0e2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/289a9587-42f5-43a3-b624-eaed487ef0e2', 'metadata': {}}]). {{(pid=87013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 10:43:29 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11" returned: 0 in 0.433s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:29 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11 Sep 30 10:43:29 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 10:43:29 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Image download 0.00 MB at 0.00 MB/s Sep 30 10:43:29 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-fa9f1525-1cd3-4533-92f5-330123be1cd0" returned: 0 in 0.298s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-fa9f1525-1cd3-4533-92f5-330123be1cd0" released by "delete_volume" :: held 0.801s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39cf74a-f99e-44d3-87b1-efa477c038a1]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created reservations ['7a3ede25-922b-471d-a33c-7a2e7f57bd36', '75c9211a-e15e-4c38-bb85-4b47d0b33e15', '2f47fd27-b5c6-4f78-87bf-555aa4dd63cc', 'c7ed4bb1-2260-41d2-adbc-fbc8b77fb203'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:29 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD Sep 30 10:43:29 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:29 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:29 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:29 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c62a1339-cf27-4f08-9650-907a9f500e11" returned: 0 in 0.288s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-c62a1339-cf27-4f08-9650-907a9f500e11" released by "delete_volume" :: held 0.806s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Created reservations ['882a5c69-28df-4d2c-8f78-cd55a47d29bd', '43940171-88cd-4ded-8021-25fc6f8b8e3b', '20a7d669-40c0-4aa9-845a-8b4658cbc8f6', '693747d1-5360-4511-b11e-33044fa55900'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-ad91f363-ae2c-4c56-b9a5-db95d905ed61-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-ad91f363-ae2c-4c56-b9a5-db95d905ed61-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:30 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.321s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:30 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:30 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:30 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Deleted volume successfully. Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD" returned: 0 in 0.489s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-quobyte-ad91f363-ae2c-4c56-b9a5-db95d905ed61" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0d1f0e3a-407b-4770-88e6-eb4eea166925 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-fa9f1525-1cd3-4533-92f5-330123be1cd0-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-ad91f363-ae2c-4c56-b9a5-db95d905ed61" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1193cb-b6dd-4bce-9b09-2af218709ad7]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:30 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD Sep 30 10:43:30 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:30 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61 Sep 30 10:43:30 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:30 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.326s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:30 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Deleted volume successfully. Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-316079bd-2704-4af9-905e-a39b2ab81272 tempest-ProjectReaderTests-458189389 None] Lock "cinder-c62a1339-cf27-4f08-9650-907a9f500e11-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:30 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD" returned: 1 in 0.465s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Temporary image 289a9587-42f5-43a3-b624-eaed487ef0e2 is fetched for user 305b0c8b487e4b8cbf758b2d51dd463b. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 10:43:30 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61" returned: 0 in 0.421s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:30 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61 Sep 30 10:43:30 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Flow 'volume_create_manager' (36950973-f9e2-4b0f-beb0-3ee9c24c23ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3d912d-e8f5-4fe1-96c9-b18a5ade8263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7965fcc-9f0f-4dac-917a-cb5e4379a64e]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3d912d-e8f5-4fe1-96c9-b18a5ade8263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100001034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df27f82a-3b0d-4db2-82c6-ba4b3aa374cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51048571c2014127a8fe81716d0f54a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:31Z,use_quota=True,user_id='8faa299a205b43419b67ca7d7b29fe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c593d845-72ab-49a9-a2ff-483ef8c07c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c593d845-72ab-49a9-a2ff-483ef8c07c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10df934-24c8-4869-b5eb-0fe155597628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10df934-24c8-4869-b5eb-0fe155597628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df27f82a-3b0d-4db2-82c6-ba4b3aa374cd', 'volume_name': 'volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5af0d88-1bf4-4866-baec-45ef5b9c6746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5af0d88-1bf4-4866-baec-45ef5b9c6746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01603854-22d6-4418-b12c-346a042fea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:30 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Volume df27f82a-3b0d-4db2-82c6-ba4b3aa374cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd', 'volume_size': 1} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100001034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df27f82a-3b0d-4db2-82c6-ba4b3aa374cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51048571c2014127a8fe81716d0f54a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:31Z,use_quota=True,user_id='8faa299a205b43419b67ca7d7b29fe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Creating volume df27f82a-3b0d-4db2-82c6-ba4b3aa374cd {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:30 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:31 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd 1073741824 Sep 30 10:43:31 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:31 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD Sep 30 10:43:31 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:31 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-ad91f363-ae2c-4c56-b9a5-db95d905ed61" returned: 0 in 0.264s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-ad91f363-ae2c-4c56-b9a5-db95d905ed61" released by "delete_volume" :: held 0.736s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created reservations ['2c0f1779-70f2-41b0-b395-f07219116bc6', '25d01031-6d88-4349-9f98-2081e8849a9a', '381d9743-d3e1-4220-b800-2e6cb7bcd305', 'ea08a10e-9841-4b44-a8fb-7b631e08b834'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:31 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:31 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:31 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-02a350d0-9545-45e4-8aa1-2f706279bf44-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-02a350d0-9545-45e4-8aa1-2f706279bf44-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "cinder-quobyte-02a350d0-9545-45e4-8aa1-2f706279bf44" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:31 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-02a350d0-9545-45e4-8aa1-2f706279bf44" acquired by "delete_volume" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:31 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:31 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.305s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:31 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Deleted volume successfully. Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5731d9d8-3ec3-44b5-874b-1376981c08a5]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-89d21147-e9dc-4fc9-b7fb-b5c817d558e2 tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-ad91f363-ae2c-4c56-b9a5-db95d905ed61-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:31 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd 1073741824" returned: 0 in 0.601s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:31 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44 Sep 30 10:43:31 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:31 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd Sep 30 10:43:31 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:31 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD" returned: 1 in 0.447s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:31 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" returned: 0 in 0.260s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.176s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb62e58a-5464-47de-9a80-1f2cb359c455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14b334e501246c881fdd470bbbfa0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:29Z,use_quota=True,user_id='305b0c8b487e4b8cbf758b2d51dd463b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Creating volume cb62e58a-5464-47de-9a80-1f2cb359c455 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:31 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:31 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44" returned: 0 in 0.431s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:31 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 1073741824 Sep 30 10:43:31 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01603854-22d6-4418-b12c-346a042fea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54d895e-3390-40bf-9927-e52ded8f4257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:31 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44 Sep 30 10:43:31 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:31 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Volume volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd (df27f82a-3b0d-4db2-82c6-ba4b3aa374cd): created successfully Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54d895e-3390-40bf-9927-e52ded8f4257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:31 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Flow 'volume_create_manager' (36950973-f9e2-4b0f-beb0-3ee9c24c23ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-7fbcccf1-0a23-41d4-b685-f76ea6a9cea8 tempest-ProjectReaderTests-458189389 None] Created volume successfully. Sep 30 10:43:32 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-02a350d0-9545-45e4-8aa1-2f706279bf44" returned: 0 in 0.259s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-quobyte-02a350d0-9545-45e4-8aa1-2f706279bf44" released by "delete_volume" :: held 0.753s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Created reservations ['a7e4137a-3079-4e6c-9271-3a69d1b02281', '2b02527a-652d-471a-9aea-5e626ab605e1', '0a7b0cea-a507-4b03-9234-5cad2595d222', '37cab03d-5d01-4cde-93e4-975d456039f9'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:32 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 1073741824" returned: 0 in 0.468s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:32 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:32 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:32 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 Sep 30 10:43:32 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:32 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.274s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Deleted volume successfully. Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-25438ee2-c069-4e8e-9cf6-e52b67992a7f tempest-CreateVolumesFromSourceVolumeTest-976601484 None] Lock "cinder-02a350d0-9545-45e4-8aa1-2f706279bf44-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:32 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455" returned: 0 in 0.263s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Attempting download of 289a9587-42f5-43a3-b624-eaed487ef0e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/289a9587-42f5-43a3-b624-eaed487ef0e2', 'metadata': {}}])) to volume cb62e58a-5464-47de-9a80-1f2cb359c455. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfb09e6-f099-4983-83bc-c3eda3f5abf8]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_289a9587-42f5-43a3-b624-eaed487ef0e2_7i5ls7f0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:32 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_289a9587-42f5-43a3-b624-eaed487ef0e2_7i5ls7f0 Sep 30 10:43:32 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Creating offline snapshot 5c4051b9-184a-46eb-b98f-1fce5abc5ac3 of volume df27f82a-3b0d-4db2-82c6-ba4b3aa374cd {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:43:33 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_289a9587-42f5-43a3-b624-eaed487ef0e2_7i5ls7f0" returned: 0 in 0.373s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_289a9587-42f5-43a3-b624-eaed487ef0e2_7i5ls7f0 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21468ed-ae93-4e5f-a938-cfc59d195996]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:33 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_289a9587-42f5-43a3-b624-eaed487ef0e2_7i5ls7f0 Sep 30 10:43:33 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd Sep 30 10:43:33 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:33 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:33 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_289a9587-42f5-43a3-b624-eaed487ef0e2_7i5ls7f0" returned: 1 in 0.355s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_289a9587-42f5-43a3-b624-eaed487ef0e2_7i5ls7f0' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fdb7bf-71c3-40f1-88b4-c4e32a13bddf]: (4, 'raw') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:33 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" returned: 0 in 0.413s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:33 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 1G Sep 30 10:43:33 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:33 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD Sep 30 10:43:33 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:33 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:33 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD Sep 30 10:43:33 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:34 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 1G" returned: 0 in 0.483s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:34 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 Sep 30 10:43:34 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:34 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] 289a9587-42f5-43a3-b624-eaed487ef0e2 was raw, converting to qcow2 {{(pid=87013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:34 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 Sep 30 10:43:34 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:34 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3" returned: 0 in 0.324s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:34 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 is being set with open permissions: ugo+rw Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:34 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 Sep 30 10:43:34 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:34 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3" returned: 0 in 0.327s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:34 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.info Sep 30 10:43:34 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:34 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455" returned: 0 in 0.530s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_289a9587-42f5-43a3-b624-eaed487ef0e2_uxq5kex3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:43:34 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 10:43:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:34 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 1G Sep 30 10:43:34 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:35 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.info" returned: 0 in 0.281s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:35 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.info is being set with open permissions: ugo+rw Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:35 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.info Sep 30 10:43:35 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:35 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 1G" returned: 0 in 0.346s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Downloaded image 289a9587-42f5-43a3-b624-eaed487ef0e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/289a9587-42f5-43a3-b624-eaed487ef0e2', 'metadata': {}}])) to volume cb62e58a-5464-47de-9a80-1f2cb359c455 successfully. {{(pid=87013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Temporary image 289a9587-42f5-43a3-b624-eaed487ef0e2 for user 305b0c8b487e4b8cbf758b2d51dd463b is deleted. {{(pid=87013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.volume_utils [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Marking volume cb62e58a-5464-47de-9a80-1f2cb359c455 as bootable. {{(pid=87013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Copying metadata from image 289a9587-42f5-43a3-b624-eaed487ef0e2 to cb62e58a-5464-47de-9a80-1f2cb359c455. {{(pid=87013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Creating volume glance metadata for volume cb62e58a-5464-47de-9a80-1f2cb359c455 backed by image 289a9587-42f5-43a3-b624-eaed487ef0e2 with: {'image_id': '289a9587-42f5-43a3-b624-eaed487ef0e2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7f126cf7c6f977cfe19f6497c360da96', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c77e30-da2d-498d-92f6-1e5cfd22041c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb62e58a-5464-47de-9a80-1f2cb359c455', 'volume_size': 1, 'image_id': '289a9587-42f5-43a3-b624-eaed487ef0e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/289a9587-42f5-43a3-b624-eaed487ef0e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f126cf7c6f977cfe19f6497c360da96', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a14b334e501246c881fdd470bbbfa0be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7df92aa6a45a3a743b37e218500831f515e9c797772cb471ad031114b9831caff7b1e51d5fba9a92a95c644ffef1c314efbad85370b4e44fc4b37399bf2e9aea', 'id': '289a9587-42f5-43a3-b624-eaed487ef0e2', 'created_at': datetime.datetime(2026, 9, 30, 8, 43, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 8, 43, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/289a9587-42f5-43a3-b624-eaed487ef0e2/file', 'properties': {}}, 'image_service': }' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a694fb-dc82-4a8a-a516-d9ba47aff04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:35 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Volume volume-cb62e58a-5464-47de-9a80-1f2cb359c455 (cb62e58a-5464-47de-9a80-1f2cb359c455): created successfully Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a694fb-dc82-4a8a-a516-d9ba47aff04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Flow 'volume_create_manager' (36216110-06c3-41cd-b6d9-0b39c3493a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8a5c4b91-d07d-47c8-9d32-20a6e31f619d tempest-VolumeImageDependencyTests-1294141615 None] Created volume successfully. Sep 30 10:43:35 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.info" returned: 0 in 0.289s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ed06cee7-bcd1-42f8-8386-f033755a5514 tempest-ProjectReaderTests-458189389 None] Create snapshot completed successfully Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Flow 'volume_create_manager' (54399f71-6914-4d40-a328-a3e80b2461ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73a7f68-84c2-41c6-ad00-5babfd16e7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73a7f68-84c2-41c6-ad00-5babfd16e7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9770d533-6c0b-49fd-9bcd-14ad7e686cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3498d8a0e06c40fc9ee7bc2ce2e88893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:36Z,use_quota=True,user_id='8a3b4f919db74e2da6fc369d9d536de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a887185-0e81-4b8d-b303-325cd059977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a887185-0e81-4b8d-b303-325cd059977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47023718-f9d5-4558-b895-08709de9b590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47023718-f9d5-4558-b895-08709de9b590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9770d533-6c0b-49fd-9bcd-14ad7e686cc6', 'volume_name': 'volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a568e23-7c02-49a1-a1b3-a20db0af1195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a568e23-7c02-49a1-a1b3-a20db0af1195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0536c103-f79d-4a51-9924-febc1e269c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:35 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Volume 9770d533-6c0b-49fd-9bcd-14ad7e686cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6', 'volume_size': 1} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9770d533-6c0b-49fd-9bcd-14ad7e686cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3498d8a0e06c40fc9ee7bc2ce2e88893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:36Z,use_quota=True,user_id='8a3b4f919db74e2da6fc369d9d536de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Creating volume 9770d533-6c0b-49fd-9bcd-14ad7e686cc6 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:35 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Acquiring lock "cinder-cb62e58a-5464-47de-9a80-1f2cb359c455-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:35 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6 1073741824 Sep 30 10:43:35 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Lock "cinder-cb62e58a-5464-47de-9a80-1f2cb359c455-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Acquiring lock "cinder-quobyte-cb62e58a-5464-47de-9a80-1f2cb359c455" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Lock "cinder-quobyte-cb62e58a-5464-47de-9a80-1f2cb359c455" acquired by "delete_volume" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc22388-f55c-4be6-8893-f1792eb12f7a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:35 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 Sep 30 10:43:35 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:36 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6 1073741824" returned: 0 in 0.431s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:36 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6 Sep 30 10:43:36 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:36 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455" returned: 0 in 0.410s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-5c4051b9-184a-46eb-b98f-1fce5abc5ac3-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:36 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455 Sep 30 10:43:36 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Lock "cinder-5c4051b9-184a-46eb-b98f-1fce5abc5ac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-5c4051b9-184a-46eb-b98f-1fce5abc5ac3" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-5c4051b9-184a-46eb-b98f-1fce5abc5ac3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Deleting offline snapshot 5c4051b9-184a-46eb-b98f-1fce5abc5ac3 of volume df27f82a-3b0d-4db2-82c6-ba4b3aa374cd {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] snapshot_file for this snap is: volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1400777e-91c5-4238-ac9c-ba1c430d2fde]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:36 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6" returned: 0 in 0.274s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0536c103-f79d-4a51-9924-febc1e269c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35040c8-bcee-469c-bc42-946edba10e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:36 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 Sep 30 10:43:36 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:36 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Volume volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6 (9770d533-6c0b-49fd-9bcd-14ad7e686cc6): created successfully Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35040c8-bcee-469c-bc42-946edba10e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:36 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Flow 'volume_create_manager' (54399f71-6914-4d40-a328-a3e80b2461ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cb62e58a-5464-47de-9a80-1f2cb359c455" returned: 0 in 0.297s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:36 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e843dc50-44cf-440e-bf54-3c84d6e8f6e9 tempest-CinderUnicodeTest-708391434 None] Created volume successfully. Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Lock "cinder-quobyte-cb62e58a-5464-47de-9a80-1f2cb359c455" released by "delete_volume" :: held 0.768s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=221,cinder:UPDATE=312,cinder:INSERT=89,cinder:DELETE=28 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Created reservations ['d3b14c34-f8f4-48ec-8f97-f8b9291a6a4b', '0ad34155-d1ad-424b-a27e-3888ef13ca51', '980ea1d5-4245-4faa-ba45-b3a57ad5bebf', '188edc9d-2f26-4b9f-9fd0-7948dbf6cf28'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:36 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:36 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:36 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3" returned: 0 in 0.455s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3547cd42-a140-4e11-ad40-26d387bf3938]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:37 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:37 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd Sep 30 10:43:37 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.329s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:37 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Deleted volume successfully. Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=309,cinder:SELECT=231,cinder:DELETE=29,cinder:INSERT=76 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:43:37 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:37 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f04dbfe0-42ca-429c-bfc3-2e9825461734 tempest-VolumeImageDependencyTests-1294141615 None] Lock "cinder-cb62e58a-5464-47de-9a80-1f2cb359c455-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Flow 'volume_create_manager' (af4ccc9d-b2a2-46e5-909c-24bff5d90046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d477341-b444-40e2-9058-55907961031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d477341-b444-40e2-9058-55907961031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-873988625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a67a05-0892-47e8-828b-56b1c4ef7557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3498d8a0e06c40fc9ee7bc2ce2e88893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:37Z,use_quota=True,user_id='8a3b4f919db74e2da6fc369d9d536de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78638622-0b72-46bf-90cd-75d150596f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78638622-0b72-46bf-90cd-75d150596f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:37 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774a4c1b-99c2-47fb-8a98-4c798ef43f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774a4c1b-99c2-47fb-8a98-4c798ef43f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a67a05-0892-47e8-828b-56b1c4ef7557', 'volume_name': 'volume-47a67a05-0892-47e8-828b-56b1c4ef7557', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d88ee0-168d-4418-be86-9269e4323756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d88ee0-168d-4418-be86-9269e4323756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130f1a92-0b05-44d8-a288-7854e6f388e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:37 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Volume 47a67a05-0892-47e8-828b-56b1c4ef7557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a67a05-0892-47e8-828b-56b1c4ef7557', 'volume_size': 1} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:37 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-873988625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a67a05-0892-47e8-828b-56b1c4ef7557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3498d8a0e06c40fc9ee7bc2ce2e88893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:37Z,use_quota=True,user_id='8a3b4f919db74e2da6fc369d9d536de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Creating volume 47a67a05-0892-47e8-828b-56b1c4ef7557 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:37 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.409s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" returned: 0 in 0.550s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:37 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 1073741824 Sep 30 10:43:37 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:43:37 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 Sep 30 10:43:37 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:37 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3" returned: 0 in 0.375s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:37 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3 Sep 30 10:43:37 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:37 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 1073741824" returned: 0 in 0.506s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:38 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 Sep 30 10:43:38 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:38 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd.5c4051b9-184a-46eb-b98f-1fce5abc5ac3" returned: 0 in 0.295s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-5c4051b9-184a-46eb-b98f-1fce5abc5ac3" released by "_delete_snapshot" :: held 1.820s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" released by "delete_snapshot" :: held 1.850s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Created reservations ['fd0aa672-6e5e-4716-ba9b-0813313e99dc', '158276c2-3949-416d-b426-249dfddd04bb', 'd8cb4d8f-0bb8-4e09-8530-1d30b92e8cf5', 'a66fa317-d035-468d-8cb9-a2984f57d9ae'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:38 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557" returned: 0 in 0.295s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130f1a92-0b05-44d8-a288-7854e6f388e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a67a05-0892-47e8-828b-56b1c4ef7557', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6963343b-5fa1-44df-8933-9ac4404f8b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:38 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Volume volume-47a67a05-0892-47e8-828b-56b1c4ef7557 (47a67a05-0892-47e8-828b-56b1c4ef7557): created successfully Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6963343b-5fa1-44df-8933-9ac4404f8b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Flow 'volume_create_manager' (af4ccc9d-b2a2-46e5-909c-24bff5d90046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-971e8d59-8c42-47a2-a2f6-63d657cca7aa tempest-CinderUnicodeTest-708391434 None] Created volume successfully. Sep 30 10:43:38 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Delete snapshot completed successfully. Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2c88a544-15c5-45cc-93ce-c3a93f27ff02 tempest-ProjectReaderTests-458189389 None] Lock "cinder-5c4051b9-184a-46eb-b98f-1fce5abc5ac3-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Lock "cinder-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95dbc63-84f1-4178-9d5d-342759d90f05]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:38 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd Sep 30 10:43:38 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:38 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" returned: 0 in 0.374s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:39 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd Sep 30 10:43:39 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:39 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" returned: 0 in 0.258s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd" released by "delete_volume" :: held 0.717s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Created reservations ['7f0d73d2-3bf9-4b93-81ba-9e7995cee295', '2b7c088d-bb07-422d-aa95-9aac9c26346b', '16cc3159-8171-459d-9259-5b3e9d753ece', '1e3060c1-0e93-4af7-a1bc-db2a55fbf422'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:39 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:39 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Creating offline snapshot 592752a7-14dc-42fa-9f47-6966bdd5ba3b of volume 47a67a05-0892-47e8-828b-56b1c4ef7557 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5ebefa-e6dd-4cf3-8ef5-676e2b12b0b0]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:39 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.340s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Deleted volume successfully. Sep 30 10:43:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-84344e09-3601-4407-a7a8-75e92d0c5973 tempest-ProjectReaderTests-458189389 None] Lock "cinder-df27f82a-3b0d-4db2-82c6-ba4b3aa374cd-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:39 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 Sep 30 10:43:39 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Flow 'volume_create_manager' (7bdc3bf0-2a2e-4a98-ad4b-b0e4b85823af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbc5d41-1927-41da-8630-38243a1ba420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:40 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557" returned: 0 in 0.453s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbc5d41-1927-41da-8630-38243a1ba420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-619573634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da5f020-f5cd-40ae-b5f1-15b71a045395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51048571c2014127a8fe81716d0f54a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:40Z,use_quota=True,user_id='8faa299a205b43419b67ca7d7b29fe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:40 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b 1G Sep 30 10:43:40 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604f44d2-1ee0-4318-85f8-07020f55ffdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604f44d2-1ee0-4318-85f8-07020f55ffdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49688eb7-069f-4a35-96c5-0cfc7a74178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49688eb7-069f-4a35-96c5-0cfc7a74178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da5f020-f5cd-40ae-b5f1-15b71a045395', 'volume_name': 'volume-9da5f020-f5cd-40ae-b5f1-15b71a045395', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eefa21a-f57e-4667-8b2f-77d0165878b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eefa21a-f57e-4667-8b2f-77d0165878b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d193ecad-e915-4bf7-aece-ad5048538658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:40 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Volume 9da5f020-f5cd-40ae-b5f1-15b71a045395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da5f020-f5cd-40ae-b5f1-15b71a045395', 'volume_size': 1} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d737d55e-f926-472c-8b96-758927013197 tempest-ProjectAdminTests-79920770 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.958896636963, 'free_capacity_gb': 1774.958896636963, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87013) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 30 10:43:40 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b 1G" returned: 0 in 0.467s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a67a05-0892-47e8-828b-56b1c4ef7557 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:40 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a67a05-0892-47e8-828b-56b1c4ef7557 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b Sep 30 10:43:40 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:40 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a67a05-0892-47e8-828b-56b1c4ef7557 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b" returned: 0 in 0.300s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:40 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b is being set with open permissions: ugo+rw Sep 30 10:43:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:40 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b Sep 30 10:43:40 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:41 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b" returned: 0 in 0.260s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:41 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.info Sep 30 10:43:41 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:41 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.info" returned: 0 in 0.263s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:41 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.info is being set with open permissions: ugo+rw Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:41 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.info Sep 30 10:43:41 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:41 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.info" returned: 0 in 0.276s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-619573634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da5f020-f5cd-40ae-b5f1-15b71a045395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51048571c2014127a8fe81716d0f54a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:40Z,use_quota=True,user_id='8faa299a205b43419b67ca7d7b29fe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Creating volume 9da5f020-f5cd-40ae-b5f1-15b71a045395 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:41 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:41 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 1073741824 Sep 30 10:43:41 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:41 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-20f829fd-f18e-4986-a101-3256f2914213 tempest-CinderUnicodeTest-708391434 None] Create snapshot completed successfully Sep 30 10:43:42 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 1073741824" returned: 0 in 0.485s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:42 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 Sep 30 10:43:42 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:42 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395" returned: 0 in 0.268s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d193ecad-e915-4bf7-aece-ad5048538658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da5f020-f5cd-40ae-b5f1-15b71a045395', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231d5828-2d72-4a31-9d85-97426b443c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:42 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Volume volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 (9da5f020-f5cd-40ae-b5f1-15b71a045395): created successfully Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231d5828-2d72-4a31-9d85-97426b443c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Flow 'volume_create_manager' (7bdc3bf0-2a2e-4a98-ad4b-b0e4b85823af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:42 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9ed3af4a-036d-450e-94ec-1036ad893c4d tempest-ProjectReaderTests-458189389 None] Created volume successfully. Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Acquiring lock "cinder-592752a7-14dc-42fa-9f47-6966bdd5ba3b-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Lock "cinder-592752a7-14dc-42fa-9f47-6966bdd5ba3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Acquiring lock "cinder-quobyte-47a67a05-0892-47e8-828b-56b1c4ef7557" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Lock "cinder-quobyte-47a67a05-0892-47e8-828b-56b1c4ef7557" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Acquiring lock "cinder-quobyte-592752a7-14dc-42fa-9f47-6966bdd5ba3b" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Lock "cinder-quobyte-592752a7-14dc-42fa-9f47-6966bdd5ba3b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Deleting offline snapshot 592752a7-14dc-42fa-9f47-6966bdd5ba3b of volume 47a67a05-0892-47e8-828b-56b1c4ef7557 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] snapshot_file for this snap is: volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a262ed72-5d65-441a-af23-987e8056f33a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:43 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b Sep 30 10:43:43 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:43 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b" returned: 0 in 0.371s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a67a05-0892-47e8-828b-56b1c4ef7557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dcd903-a11a-4242-a2fc-f9b91f5548a6]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:43 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 Sep 30 10:43:43 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Creating offline snapshot a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 of volume 9da5f020-f5cd-40ae-b5f1-15b71a045395 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f2b375-6fc6-4817-ac08-57ecdebc7229]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:43 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 Sep 30 10:43:43 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:43 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557" returned: 0 in 0.436s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:43 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b Sep 30 10:43:43 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:43 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395" returned: 0 in 0.394s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:44 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 1G Sep 30 10:43:44 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:44 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b" returned: 0 in 0.382s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:44 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b Sep 30 10:43:44 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:44 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 1G" returned: 0 in 0.476s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:44 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557.592752a7-14dc-42fa-9f47-6966bdd5ba3b" returned: 0 in 0.288s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:44 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 Sep 30 10:43:44 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Lock "cinder-quobyte-592752a7-14dc-42fa-9f47-6966bdd5ba3b" released by "_delete_snapshot" :: held 1.638s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Lock "cinder-quobyte-47a67a05-0892-47e8-828b-56b1c4ef7557" released by "delete_snapshot" :: held 1.665s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Created reservations ['7d4bbe3c-889f-4068-b71e-d734f9561531', '100b08e3-08ef-4d95-8ae6-cf3deb1da135', '1572cbfe-6eff-419b-94af-7ab481cc2b57', '4ea6c0a8-a78a-4fda-9101-b2a6a70a0041'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Delete snapshot completed successfully. Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ff9dc9d6-e650-49c5-8287-818cd8a7488e tempest-CinderUnicodeTest-708391434 None] Lock "cinder-592752a7-14dc-42fa-9f47-6966bdd5ba3b-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:44 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5" returned: 0 in 0.335s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:44 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 is being set with open permissions: ugo+rw Sep 30 10:43:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:44 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 Sep 30 10:43:44 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Acquiring lock "cinder-47a67a05-0892-47e8-828b-56b1c4ef7557-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Lock "cinder-47a67a05-0892-47e8-828b-56b1c4ef7557-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:45 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5" returned: 0 in 0.276s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Acquiring lock "cinder-quobyte-47a67a05-0892-47e8-828b-56b1c4ef7557" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Lock "cinder-quobyte-47a67a05-0892-47e8-828b-56b1c4ef7557" acquired by "delete_volume" :: waited 0.039s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:45 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.info Sep 30 10:43:45 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[266c8c46-0de6-4646-bd5a-18a76646fefb]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:45 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 Sep 30 10:43:45 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:45 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.info" returned: 0 in 0.269s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:45 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.info is being set with open permissions: ugo+rw Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:45 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.info Sep 30 10:43:45 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:45 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557" returned: 0 in 0.425s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:45 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557 Sep 30 10:43:45 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:45 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.info" returned: 0 in 0.281s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:45 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-65af78c6-bb0d-4759-924b-c5f0dcaa34d2 tempest-ProjectReaderTests-458189389 None] Create snapshot completed successfully Sep 30 10:43:45 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-47a67a05-0892-47e8-828b-56b1c4ef7557" returned: 0 in 0.266s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Lock "cinder-quobyte-47a67a05-0892-47e8-828b-56b1c4ef7557" released by "delete_volume" :: held 0.768s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:45 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Created reservations ['77c7dfc8-edfd-4cc2-8891-390ba7b8a3d3', 'bb1202f1-2825-4686-8803-8dc82c3d5e5d', '2ac1db05-77bc-45fd-a22d-2aa1117b5879', 'ce1f4ba1-a5f7-4466-93a6-9352bd99dc7c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:46 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:46 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Acquiring lock "cinder-9770d533-6c0b-49fd-9bcd-14ad7e686cc6-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Lock "cinder-9770d533-6c0b-49fd-9bcd-14ad7e686cc6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Acquiring lock "cinder-quobyte-9770d533-6c0b-49fd-9bcd-14ad7e686cc6" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:46 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.315s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Lock "cinder-quobyte-9770d533-6c0b-49fd-9bcd-14ad7e686cc6" acquired by "delete_volume" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:46 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Deleted volume successfully. Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d61e2a8-9018-418d-a0af-4938a79d5c2d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-21e01667-9b9b-462f-b229-19119a28a0cb tempest-CinderUnicodeTest-708391434 None] Lock "cinder-47a67a05-0892-47e8-828b-56b1c4ef7557-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:46 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6 Sep 30 10:43:46 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-a3335479-d4d5-49fb-8ccd-0c5ef84e32f5-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Lock "cinder-a3335479-d4d5-49fb-8ccd-0c5ef84e32f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-9da5f020-f5cd-40ae-b5f1-15b71a045395" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:46 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6" returned: 0 in 0.441s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-9da5f020-f5cd-40ae-b5f1-15b71a045395" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-a3335479-d4d5-49fb-8ccd-0c5ef84e32f5" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:46 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6 Sep 30 10:43:46 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-a3335479-d4d5-49fb-8ccd-0c5ef84e32f5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Deleting offline snapshot a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 of volume 9da5f020-f5cd-40ae-b5f1-15b71a045395 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] snapshot_file for this snap is: volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[278e3331-8f0e-42fa-a4b0-393a05a6a187]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:46 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:47 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 Sep 30 10:43:47 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:47 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9770d533-6c0b-49fd-9bcd-14ad7e686cc6" returned: 0 in 0.279s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Lock "cinder-quobyte-9770d533-6c0b-49fd-9bcd-14ad7e686cc6" released by "delete_volume" :: held 0.773s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Created reservations ['c7aaab65-933d-4169-a274-e6e54becfae0', '899e9635-4cbc-431c-81c1-7d28ecd705c8', 'b75a639b-26b2-4fd2-915d-aeee7d88241a', '087250fc-d4a5-4310-b3bf-4892ddcbe205'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:47 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5" returned: 0 in 0.395s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da5f020-f5cd-40ae-b5f1-15b71a045395(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:43:47 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:47 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[214494b7-4c92-4b2a-b72a-2bb665222db9]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:47 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 Sep 30 10:43:47 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:47 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.325s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:47 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Deleted volume successfully. Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-63378875-6d9d-4641-8a84-b9748286280e tempest-CinderUnicodeTest-708391434 None] Lock "cinder-9770d533-6c0b-49fd-9bcd-14ad7e686cc6-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:47 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395" returned: 0 in 0.422s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:47 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:47 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 Sep 30 10:43:47 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:48 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5" returned: 0 in 0.400s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:48 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5 Sep 30 10:43:48 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:48 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:48 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395.a3335479-d4d5-49fb-8ccd-0c5ef84e32f5" returned: 0 in 0.295s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-a3335479-d4d5-49fb-8ccd-0c5ef84e32f5" released by "_delete_snapshot" :: held 1.665s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-9da5f020-f5cd-40ae-b5f1-15b71a045395" released by "delete_snapshot" :: held 1.702s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:48 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Created reservations ['1c812a4f-d75a-4cef-b5dc-c0afe1bc04b9', '724f7412-8fd8-438d-b3fa-3bbb49d9df0c', '4d2ecb30-dee8-4b36-992f-c2313e7cf083', '47376527-d139-4451-9d68-c5d0a889487c'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:48 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Delete snapshot completed successfully. Sep 30 10:43:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-5e2f1f98-e7b4-459f-964d-f851dbbde137 tempest-ProjectReaderTests-458189389 None] Lock "cinder-a3335479-d4d5-49fb-8ccd-0c5ef84e32f5-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:48 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-9da5f020-f5cd-40ae-b5f1-15b71a045395-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Lock "cinder-9da5f020-f5cd-40ae-b5f1-15b71a045395-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-9da5f020-f5cd-40ae-b5f1-15b71a045395" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-9da5f020-f5cd-40ae-b5f1-15b71a045395" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75a513d-551a-4a12-8340-12e053516db8]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:49 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 Sep 30 10:43:49 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:49 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395" returned: 0 in 0.423s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:49 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395 Sep 30 10:43:49 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:49 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da5f020-f5cd-40ae-b5f1-15b71a045395" returned: 0 in 0.252s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-9da5f020-f5cd-40ae-b5f1-15b71a045395" released by "delete_volume" :: held 0.748s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (55c3bb12-0880-42a3-9505-06c5f0965935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c49eb5c-248c-44d4-8c68-b9bec4c62ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c49eb5c-248c-44d4-8c68-b9bec4c62ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243007802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98aae159-f178-4935-82c1-cb4c8884dfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:50Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a541e20-7fce-48cb-b419-245172c21bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a541e20-7fce-48cb-b419-245172c21bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad575211-1bc4-4efd-be38-8d2d08ab641a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad575211-1bc4-4efd-be38-8d2d08ab641a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98aae159-f178-4935-82c1-cb4c8884dfc1', 'volume_name': 'volume-98aae159-f178-4935-82c1-cb4c8884dfc1', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0437e031-e2eb-4c03-a1e6-e971744ba85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:49 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0437e031-e2eb-4c03-a1e6-e971744ba85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a684830-ad1c-4181-9df0-0cd4b1ff870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:50 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Volume 98aae159-f178-4935-82c1-cb4c8884dfc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98aae159-f178-4935-82c1-cb4c8884dfc1', 'volume_size': 1} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243007802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98aae159-f178-4935-82c1-cb4c8884dfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:50Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Creating volume 98aae159-f178-4935-82c1-cb4c8884dfc1 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:50 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:50 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 1073741824 Sep 30 10:43:50 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Created reservations ['dc81b1f0-64af-4e57-9ac2-951e6a38b069', 'aa1a8e7c-9600-44d3-8a4f-baa35edeff66', 'f9edfa72-abc1-4017-bf72-2f5e6cb64c8b', '83ed7f1c-d15f-45a8-9c5d-37f17812c85d'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:50 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:50 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:50 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.327s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:50 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Deleted volume successfully. Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-9f5c6f34-120c-42f6-b527-07fe16ef822e tempest-ProjectReaderTests-458189389 None] Lock "cinder-9da5f020-f5cd-40ae-b5f1-15b71a045395-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:50 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 1073741824" returned: 0 in 0.625s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:50 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 Sep 30 10:43:50 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Flow 'volume_create_manager' (63b1818e-1133-406d-a4fd-054482283d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8af2334-f914-47f7-a4e8-c9643754ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8af2334-f914-47f7-a4e8-c9643754ed60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440703517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da38d28-232a-4c70-b06a-aa4f29cd114c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51048571c2014127a8fe81716d0f54a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:51Z,use_quota=True,user_id='8faa299a205b43419b67ca7d7b29fe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379362ec-7068-4735-a217-1d62ec511194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379362ec-7068-4735-a217-1d62ec511194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2e9cbb-9567-45f1-a9b8-861796d1e1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2e9cbb-9567-45f1-a9b8-861796d1e1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da38d28-232a-4c70-b06a-aa4f29cd114c', 'volume_name': 'volume-9da38d28-232a-4c70-b06a-aa4f29cd114c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa8698bf-77b4-47a1-baf4-c910fb98ca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa8698bf-77b4-47a1-baf4-c910fb98ca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af53ffe-1d2b-4d5f-8e2b-721917726ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:50 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Volume 9da38d28-232a-4c70-b06a-aa4f29cd114c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da38d28-232a-4c70-b06a-aa4f29cd114c', 'volume_size': 1} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:50 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1" returned: 0 in 0.288s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440703517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da38d28-232a-4c70-b06a-aa4f29cd114c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51048571c2014127a8fe81716d0f54a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:51Z,use_quota=True,user_id='8faa299a205b43419b67ca7d7b29fe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Creating volume 9da38d28-232a-4c70-b06a-aa4f29cd114c {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:50 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:50 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a684830-ad1c-4181-9df0-0cd4b1ff870d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98aae159-f178-4935-82c1-cb4c8884dfc1', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b6afa0-c4b7-492e-8caf-38a9e5c01ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:51 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c 1073741824 Sep 30 10:43:51 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:51 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Volume volume-98aae159-f178-4935-82c1-cb4c8884dfc1 (98aae159-f178-4935-82c1-cb4c8884dfc1): created successfully Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b6afa0-c4b7-492e-8caf-38a9e5c01ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (55c3bb12-0880-42a3-9505-06c5f0965935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:51 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-bdfd36b8-01c6-48d7-a68d-c386e7d87895 tempest-ProjectMemberTests-552928223 None] Created volume successfully. Sep 30 10:43:51 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c 1073741824" returned: 0 in 0.436s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:51 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c Sep 30 10:43:51 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:51 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c" returned: 0 in 0.268s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af53ffe-1d2b-4d5f-8e2b-721917726ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da38d28-232a-4c70-b06a-aa4f29cd114c', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a29173f-01d8-444a-bbbf-83ca12d74c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:51 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Volume volume-9da38d28-232a-4c70-b06a-aa4f29cd114c (9da38d28-232a-4c70-b06a-aa4f29cd114c): created successfully Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a29173f-01d8-444a-bbbf-83ca12d74c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Flow 'volume_create_manager' (63b1818e-1133-406d-a4fd-054482283d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:51 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d067ba2c-37f5-424b-bd39-8fab132b1ac4 tempest-ProjectReaderTests-458189389 None] Created volume successfully. Sep 30 10:43:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Creating offline snapshot 92b2a75c-126e-4263-bcaf-4171c72f0ef2 of volume 98aae159-f178-4935-82c1-cb4c8884dfc1 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:43:52 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e966a2d3-88d6-424c-bd17-9aebc22ffa39]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:52 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 Sep 30 10:43:52 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:52 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1" returned: 0 in 0.369s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:52 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 1G Sep 30 10:43:52 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:53 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 1G" returned: 0 in 0.499s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98aae159-f178-4935-82c1-cb4c8884dfc1 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:53 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98aae159-f178-4935-82c1-cb4c8884dfc1 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 Sep 30 10:43:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:53 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:53 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98aae159-f178-4935-82c1-cb4c8884dfc1 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2" returned: 0 in 0.299s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:53 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 is being set with open permissions: ugo+rw Sep 30 10:43:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:53 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 Sep 30 10:43:53 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:53 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2" returned: 0 in 0.295s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:53 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.info Sep 30 10:43:53 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:53 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.info" returned: 0 in 0.277s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:53 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.info is being set with open permissions: ugo+rw Sep 30 10:43:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:53 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.info Sep 30 10:43:53 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:54 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.info" returned: 0 in 0.258s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.164s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Creating offline snapshot b1367371-bfd3-4d73-ae8a-fd1138389c7d of volume 9da38d28-232a-4c70-b06a-aa4f29cd114c {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:43:54 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-34227281-d908-4baf-a6cc-15b4a90b2946 tempest-ProjectMemberTests-552928223 None] Create snapshot completed successfully Sep 30 10:43:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c556951e-881e-4340-827b-326facd28cbf]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:54 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c Sep 30 10:43:54 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:54 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c" returned: 0 in 0.402s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:54 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d 1G Sep 30 10:43:54 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:55 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d 1G" returned: 0 in 0.417s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da38d28-232a-4c70-b06a-aa4f29cd114c -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:55 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da38d28-232a-4c70-b06a-aa4f29cd114c -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d Sep 30 10:43:55 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-92b2a75c-126e-4263-bcaf-4171c72f0ef2-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Lock "cinder-92b2a75c-126e-4263-bcaf-4171c72f0ef2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-98aae159-f178-4935-82c1-cb4c8884dfc1" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-98aae159-f178-4935-82c1-cb4c8884dfc1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-92b2a75c-126e-4263-bcaf-4171c72f0ef2" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-92b2a75c-126e-4263-bcaf-4171c72f0ef2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Deleting offline snapshot 92b2a75c-126e-4263-bcaf-4171c72f0ef2 of volume 98aae159-f178-4935-82c1-cb4c8884dfc1 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] snapshot_file for this snap is: volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1cb166-af48-4ce4-b8e6-1ea12b3a176f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:55 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da38d28-232a-4c70-b06a-aa4f29cd114c -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d" returned: 0 in 0.331s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:55 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d is being set with open permissions: ugo+rw Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:55 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d Sep 30 10:43:55 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:55 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 Sep 30 10:43:55 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:55 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d" returned: 0 in 0.294s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:55 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.info Sep 30 10:43:55 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:55 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2" returned: 0 in 0.461s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98aae159-f178-4935-82c1-cb4c8884dfc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f4559f-d99b-42ee-af06-dbf1a6d08907]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:55 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 Sep 30 10:43:55 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:56 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.info" returned: 0 in 0.267s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:56 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.info is being set with open permissions: ugo+rw Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:56 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.info Sep 30 10:43:56 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:56 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1" returned: 0 in 0.394s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:56 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.info" returned: 0 in 0.259s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:56 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 Sep 30 10:43:56 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f65dbecb-ad91-46a0-b11e-46cbff5fe246 tempest-ProjectReaderTests-458189389 None] Create snapshot completed successfully Sep 30 10:43:56 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2" returned: 0 in 0.348s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:56 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2 Sep 30 10:43:56 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:56 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1.92b2a75c-126e-4263-bcaf-4171c72f0ef2" returned: 0 in 0.243s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-92b2a75c-126e-4263-bcaf-4171c72f0ef2" released by "_delete_snapshot" :: held 1.560s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-98aae159-f178-4935-82c1-cb4c8884dfc1" released by "delete_snapshot" :: held 1.582s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:56 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Created reservations ['5ef236d1-68e0-44b3-be74-7214c31b584c', '4b3dacc8-d65c-46b1-b2fe-93c651289647', '41310fd8-b2c3-465f-bed5-c86cd313e6d4', 'd763adae-d8a8-4894-948c-b888945b202a'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Delete snapshot completed successfully. Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-cca1b896-0aa4-478f-9577-e0bbb1bb3104 tempest-ProjectMemberTests-552928223 None] Lock "cinder-92b2a75c-126e-4263-bcaf-4171c72f0ef2-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-b1367371-bfd3-4d73-ae8a-fd1138389c7d-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Lock "cinder-b1367371-bfd3-4d73-ae8a-fd1138389c7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-9da38d28-232a-4c70-b06a-aa4f29cd114c" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-9da38d28-232a-4c70-b06a-aa4f29cd114c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-b1367371-bfd3-4d73-ae8a-fd1138389c7d" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-b1367371-bfd3-4d73-ae8a-fd1138389c7d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Deleting offline snapshot b1367371-bfd3-4d73-ae8a-fd1138389c7d of volume 9da38d28-232a-4c70-b06a-aa4f29cd114c {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] snapshot_file for this snap is: volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed74e525-3a25-423e-81e2-5dfb303c32f1]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:57 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d Sep 30 10:43:57 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-98aae159-f178-4935-82c1-cb4c8884dfc1-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Lock "cinder-98aae159-f178-4935-82c1-cb4c8884dfc1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-98aae159-f178-4935-82c1-cb4c8884dfc1" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-98aae159-f178-4935-82c1-cb4c8884dfc1" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac5004c-fb6c-41c2-81e2-e8b7bad610a5]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:57 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d" returned: 0 in 0.431s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da38d28-232a-4c70-b06a-aa4f29cd114c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:43:57 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 Sep 30 10:43:57 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a342d6-6f78-41fd-ad79-d5602fb832b3]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:57 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c Sep 30 10:43:57 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:58 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:58 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1 Sep 30 10:43:58 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:58 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c" returned: 0 in 0.372s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:58 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d Sep 30 10:43:58 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:58 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-98aae159-f178-4935-82c1-cb4c8884dfc1" returned: 0 in 0.268s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-98aae159-f178-4935-82c1-cb4c8884dfc1" released by "delete_volume" :: held 0.760s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Created reservations ['d31d66a5-7529-49c0-81b3-a6f8feb3ef1b', 'e47b664e-756b-40a7-a289-95222884ef33', '99fabb54-17be-47eb-9168-bf71a78adc5b', 'ed4ab74e-9b6e-47da-9033-0b5dc551a7d2'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:58 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:43:58 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:58 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d" returned: 0 in 0.360s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:58 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d Sep 30 10:43:58 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:58 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.273s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:43:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Deleted volume successfully. Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-2995fc31-5973-40b6-b6c6-8647f5779478 tempest-ProjectMemberTests-552928223 None] Lock "cinder-98aae159-f178-4935-82c1-cb4c8884dfc1-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:58 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c.b1367371-bfd3-4d73-ae8a-fd1138389c7d" returned: 0 in 0.288s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-b1367371-bfd3-4d73-ae8a-fd1138389c7d" released by "_delete_snapshot" :: held 1.576s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-9da38d28-232a-4c70-b06a-aa4f29cd114c" released by "delete_snapshot" :: held 1.600s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:58 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Created reservations ['bd90645a-65b1-4bf8-8860-889e4a7c62d1', '49ba7d6e-6bab-49f2-b0f0-3c2b3de5477c', '662be9f3-1ec3-4f87-9633-855392ca3899', '15a56fed-fc2e-4c11-b33c-2626983a7a7f'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:43:58 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Delete snapshot completed successfully. Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c48d53bb-87bf-4535-a040-8d8334a324c4 tempest-ProjectReaderTests-458189389 None] Lock "cinder-b1367371-bfd3-4d73-ae8a-fd1138389c7d-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (8d21b894-3815-48b3-b080-80e3f268c0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0425e248-0262-4a02-adfb-17262816e74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0425e248-0262-4a02-adfb-17262816e74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499374557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4356bd5-c49e-496f-9c9a-9e0aa7a43943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:59Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138c4a91-6e3a-477d-8886-81ad8a569f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138c4a91-6e3a-477d-8886-81ad8a569f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967f47a1-2210-44ac-b352-95964a3add70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967f47a1-2210-44ac-b352-95964a3add70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4356bd5-c49e-496f-9c9a-9e0aa7a43943', 'volume_name': 'volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b917725c-6663-4c65-ab84-b6e0994a88ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b917725c-6663-4c65-ab84-b6e0994a88ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c57a7e7-4c97-4580-92ad-5df15dda1574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:43:59 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Volume f4356bd5-c49e-496f-9c9a-9e0aa7a43943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943', 'volume_size': 1} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499374557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4356bd5-c49e-496f-9c9a-9e0aa7a43943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:43:59Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Creating volume f4356bd5-c49e-496f-9c9a-9e0aa7a43943 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:43:59 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:59 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 1073741824 Sep 30 10:43:59 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-9da38d28-232a-4c70-b06a-aa4f29cd114c-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Lock "cinder-9da38d28-232a-4c70-b06a-aa4f29cd114c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Acquiring lock "cinder-quobyte-9da38d28-232a-4c70-b06a-aa4f29cd114c" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-9da38d28-232a-4c70-b06a-aa4f29cd114c" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0bd4d2-d824-448b-9a04-cdb221493882]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:59 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c Sep 30 10:43:59 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:59 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 1073741824" returned: 0 in 0.548s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:43:59 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 Sep 30 10:43:59 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:43:59 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c" returned: 0 in 0.455s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:43:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:00 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c Sep 30 10:44:00 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:00 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" returned: 0 in 0.254s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c57a7e7-4c97-4580-92ad-5df15dda1574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179dbbec-22ed-45b6-95dc-951e988b4f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:00 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Volume volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 (f4356bd5-c49e-496f-9c9a-9e0aa7a43943): created successfully Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179dbbec-22ed-45b6-95dc-951e988b4f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (8d21b894-3815-48b3-b080-80e3f268c0c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-bd7057ff-e337-41e2-9ed3-3f8b10dd086d tempest-ProjectMemberTests-552928223 None] Created volume successfully. Sep 30 10:44:00 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-9da38d28-232a-4c70-b06a-aa4f29cd114c" returned: 0 in 0.269s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Lock "cinder-quobyte-9da38d28-232a-4c70-b06a-aa4f29cd114c" released by "delete_volume" :: held 0.815s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Created reservations ['00351bed-991e-4399-9cd9-8aeddad55717', 'd6e32a78-2ab6-4e8d-aa56-dad1d46c9855', '651056cc-2640-41cb-b8b5-d077469b672c', '4b6344d3-4d06-402a-9d09-000b76294bef'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:00 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:00 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:00 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.244s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:00 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Deleted volume successfully. Sep 30 10:44:00 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-504d6f56-4e32-406d-9102-eabad709527d tempest-ProjectReaderTests-458189389 None] Lock "cinder-9da38d28-232a-4c70-b06a-aa4f29cd114c-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:01 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Creating offline snapshot fef3c985-1e5e-4f9b-882e-3a81d8473663 of volume f4356bd5-c49e-496f-9c9a-9e0aa7a43943 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:44:01 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[60916ffd-e811-48a9-91ca-821e363bcca6]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:01 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 Sep 30 10:44:01 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:01 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" returned: 0 in 0.470s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:01 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 1G Sep 30 10:44:01 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:02 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 1G" returned: 0 in 0.522s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:02 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 Sep 30 10:44:02 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:02 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663" returned: 0 in 0.350s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:02 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 is being set with open permissions: ugo+rw Sep 30 10:44:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:02 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 Sep 30 10:44:02 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:03 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663" returned: 0 in 0.254s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:03 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.info Sep 30 10:44:03 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:03 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.info" returned: 0 in 0.265s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:03 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.info is being set with open permissions: ugo+rw Sep 30 10:44:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:03 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.info Sep 30 10:44:03 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:03 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.info" returned: 0 in 0.322s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:03 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9906cccc-2912-443c-92f1-8d8383b5373f tempest-ProjectMemberTests-552928223 None] Create snapshot completed successfully Sep 30 10:44:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-fef3c985-1e5e-4f9b-882e-3a81d8473663-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Lock "cinder-fef3c985-1e5e-4f9b-882e-3a81d8473663-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-fef3c985-1e5e-4f9b-882e-3a81d8473663" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-fef3c985-1e5e-4f9b-882e-3a81d8473663" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Deleting offline snapshot fef3c985-1e5e-4f9b-882e-3a81d8473663 of volume f4356bd5-c49e-496f-9c9a-9e0aa7a43943 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:44:04 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] snapshot_file for this snap is: volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:44:04 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbeeb30-2b2d-4eca-9798-87a369423107]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:05 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Flow 'volume_create_manager' (326cc74d-1966-4973-9022-c136d17058f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:05 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1825fcd-5e8d-46cb-b8ef-30f198209a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1825fcd-5e8d-46cb-b8ef-30f198209a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985681937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71867e622f4849ccad1cae8a12bf4b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:05Z,use_quota=True,user_id='18ce4676e77049cabfe48f1b642b2848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239b1c1-a1dc-483e-96e2-535aabcfb4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239b1c1-a1dc-483e-96e2-535aabcfb4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49a9093-cd7c-4ddf-94f3-21f64508a76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49a9093-cd7c-4ddf-94f3-21f64508a76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a', 'volume_name': 'volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a310c0a-99a6-4d2d-971f-0687979e5931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a310c0a-99a6-4d2d-971f-0687979e5931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fb98a7-3ddd-4c0f-9ea5-8099e4da9776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:05 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Volume a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a', 'volume_size': 1} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985681937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71867e622f4849ccad1cae8a12bf4b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:05Z,use_quota=True,user_id='18ce4676e77049cabfe48f1b642b2848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Creating volume a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:05 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:05 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a 1073741824 Sep 30 10:44:05 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:05 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663" returned: 0 in 0.418s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e743d81e-073c-45bd-a93c-864401c54cc5]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:05 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 Sep 30 10:44:05 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:05 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a 1073741824" returned: 0 in 0.527s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:05 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a Sep 30 10:44:05 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:05 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" returned: 0 in 0.436s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:05 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 Sep 30 10:44:05 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:05 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a" returned: 0 in 0.298s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fb98a7-3ddd-4c0f-9ea5-8099e4da9776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1737a370-a29f-4088-ab8e-4405d01508db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:06 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Volume volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a (a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a): created successfully Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1737a370-a29f-4088-ab8e-4405d01508db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Flow 'volume_create_manager' (326cc74d-1966-4973-9022-c136d17058f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e6312144-4b4b-4155-a60e-e74521e648ff tempest-ProjectReaderTests-912697872 None] Created volume successfully. Sep 30 10:44:06 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:06 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663 Sep 30 10:44:06 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:06 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943.fef3c985-1e5e-4f9b-882e-3a81d8473663" returned: 0 in 0.246s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-fef3c985-1e5e-4f9b-882e-3a81d8473663" released by "_delete_snapshot" :: held 1.633s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" released by "delete_snapshot" :: held 1.661s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Created reservations ['b2d67307-8fc0-48d0-b7ce-40db1319f2cc', '4ba5c321-3e84-4a4a-95e1-32e8f00998b7', '020de156-3797-4d0c-bce0-24725c5da776', '680a424e-deaf-4e70-b1af-dd4cdc240cb8'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Delete snapshot completed successfully. Sep 30 10:44:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-d64b47a9-1c08-4af1-a29c-a315366a9810 tempest-ProjectMemberTests-552928223 None] Lock "cinder-fef3c985-1e5e-4f9b-882e-3a81d8473663-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-f4356bd5-c49e-496f-9c9a-9e0aa7a43943-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Lock "cinder-f4356bd5-c49e-496f-9c9a-9e0aa7a43943-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[527ff1fa-fa5b-42fa-b3d0-c95e4ad14c77]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:07 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 Sep 30 10:44:07 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Acquiring lock "cinder-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Lock "cinder-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Acquiring lock "cinder-quobyte-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Lock "cinder-quobyte-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8be762-659b-4bfb-9a47-ae6e2e61557a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:07 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" returned: 0 in 0.445s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:07 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943 Sep 30 10:44:07 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:07 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a Sep 30 10:44:07 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:07 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" returned: 0 in 0.285s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:07 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-f4356bd5-c49e-496f-9c9a-9e0aa7a43943" released by "delete_volume" :: held 0.828s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Created reservations ['77c51ce7-7d43-4b5a-a3c2-85f209be4e13', '52c1b0f3-838c-4913-a26a-fadfe4b937a0', '2f429a10-2594-4316-9d85-2df05fa36b63', '08a3a384-4802-4b43-8663-788f65467ed1'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:08 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a" returned: 0 in 0.427s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:08 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a Sep 30 10:44:08 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:08 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:08 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:08 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a" returned: 0 in 0.318s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Lock "cinder-quobyte-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a" released by "delete_volume" :: held 0.800s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Created reservations ['85e3ca0f-a6c7-4a74-80af-43588d55326a', '2039a224-46c8-43a3-94aa-9558073a9f6e', '738ea9e0-1844-47f3-a1da-ac0c354e1006', 'c3ea5291-dd3a-4722-921c-84e7f4639dff'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:08 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.294s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:08 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Deleted volume successfully. Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-aede1898-f4af-4fea-ade6-8ad17fc14f6a tempest-ProjectMemberTests-552928223 None] Lock "cinder-f4356bd5-c49e-496f-9c9a-9e0aa7a43943-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:08 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:08 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (facc16b6-46aa-49fd-8b19-8c492b6f83c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed15378-e975-4e07-a154-16050e35fffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed15378-e975-4e07-a154-16050e35fffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98851460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78afa3f-7c10-41bd-a974-ff649d508142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:09Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d48228-89a8-45a4-9eec-e42a6beac5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d48228-89a8-45a4-9eec-e42a6beac5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961b508b-9b7e-4936-b748-5a3b3b784451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961b508b-9b7e-4936-b748-5a3b3b784451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78afa3f-7c10-41bd-a974-ff649d508142', 'volume_name': 'volume-a78afa3f-7c10-41bd-a974-ff649d508142', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27173ec-0d12-484b-9b0e-fa2a1a074989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27173ec-0d12-484b-9b0e-fa2a1a074989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11aab2f-f310-4724-bc06-58f7b5edbb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:08 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Volume a78afa3f-7c10-41bd-a974-ff649d508142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78afa3f-7c10-41bd-a974-ff649d508142', 'volume_size': 1} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98851460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78afa3f-7c10-41bd-a974-ff649d508142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:09Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Creating volume a78afa3f-7c10-41bd-a974-ff649d508142 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:08 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:08 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.308s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:08 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Deleted volume successfully. Sep 30 10:44:08 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 1073741824 Sep 30 10:44:08 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:08 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-0e7df2e1-3f81-4d5b-953e-f34aa8a5404e tempest-ProjectReaderTests-912697872 None] Lock "cinder-a7166f3a-a4d3-48ee-9e0c-7c9ecf26533a-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Flow 'volume_create_manager' (ab63de53-f7f2-436d-9487-55773bd92920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c07629-8985-4148-bccf-74d72f7abe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c07629-8985-4148-bccf-74d72f7abe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1879494604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd99368f-8e69-4ca9-a6d4-582c98548e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71867e622f4849ccad1cae8a12bf4b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:09Z,use_quota=True,user_id='18ce4676e77049cabfe48f1b642b2848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f63f63a-8a68-45c7-844b-43892856f891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f63f63a-8a68-45c7-844b-43892856f891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58e6e41-e7bf-4a8b-a781-f6a51f211d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58e6e41-e7bf-4a8b-a781-f6a51f211d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd99368f-8e69-4ca9-a6d4-582c98548e46', 'volume_name': 'volume-cd99368f-8e69-4ca9-a6d4-582c98548e46', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0baf2a9-0fc0-4afc-9a47-356f3c06dba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0baf2a9-0fc0-4afc-9a47-356f3c06dba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645a49b8-7334-4cc2-b06e-722eb59667c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:09 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Volume cd99368f-8e69-4ca9-a6d4-582c98548e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd99368f-8e69-4ca9-a6d4-582c98548e46', 'volume_size': 1} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:09 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 1073741824" returned: 0 in 0.441s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:09 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 Sep 30 10:44:09 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:09 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142" returned: 0 in 0.239s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1879494604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd99368f-8e69-4ca9-a6d4-582c98548e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71867e622f4849ccad1cae8a12bf4b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:09Z,use_quota=True,user_id='18ce4676e77049cabfe48f1b642b2848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Creating volume cd99368f-8e69-4ca9-a6d4-582c98548e46 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:09 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:09 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46 1073741824 Sep 30 10:44:09 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11aab2f-f310-4724-bc06-58f7b5edbb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78afa3f-7c10-41bd-a974-ff649d508142', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f22abf-45c6-4348-a9ae-b60a9e3f7a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:09 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Volume volume-a78afa3f-7c10-41bd-a974-ff649d508142 (a78afa3f-7c10-41bd-a974-ff649d508142): created successfully Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f22abf-45c6-4348-a9ae-b60a9e3f7a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (facc16b6-46aa-49fd-8b19-8c492b6f83c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:09 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-d8d2603e-83ba-4cdb-b598-b20a64bbb3ae tempest-ProjectMemberTests-552928223 None] Created volume successfully. Sep 30 10:44:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:10 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46 1073741824" returned: 0 in 0.463s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:10 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46 Sep 30 10:44:10 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:10 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46" returned: 0 in 0.241s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.359s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645a49b8-7334-4cc2-b06e-722eb59667c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd99368f-8e69-4ca9-a6d4-582c98548e46', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e302dbd1-01aa-4cd8-a9bc-d338dae97ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Creating offline snapshot 3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 of volume a78afa3f-7c10-41bd-a974-ff649d508142 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:44:10 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Volume volume-cd99368f-8e69-4ca9-a6d4-582c98548e46 (cd99368f-8e69-4ca9-a6d4-582c98548e46): created successfully Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e302dbd1-01aa-4cd8-a9bc-d338dae97ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Flow 'volume_create_manager' (ab63de53-f7f2-436d-9487-55773bd92920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be3c2a0-d178-40ea-a710-00c3081d15fe]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:10 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c47c1bb8-b718-42f7-b889-fd00654e42ef tempest-ProjectReaderTests-912697872 None] Created volume successfully. Sep 30 10:44:10 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 Sep 30 10:44:10 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:10 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142" returned: 0 in 0.350s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:10 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 1G Sep 30 10:44:10 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:11 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 1G" returned: 0 in 0.381s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a78afa3f-7c10-41bd-a974-ff649d508142 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:11 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a78afa3f-7c10-41bd-a974-ff649d508142 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 Sep 30 10:44:11 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Acquiring lock "cinder-cd99368f-8e69-4ca9-a6d4-582c98548e46-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Lock "cinder-cd99368f-8e69-4ca9-a6d4-582c98548e46-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Acquiring lock "cinder-quobyte-cd99368f-8e69-4ca9-a6d4-582c98548e46" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Lock "cinder-quobyte-cd99368f-8e69-4ca9-a6d4-582c98548e46" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d921debc-0a4f-48bf-9c37-dc3a776ed84d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:11 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a78afa3f-7c10-41bd-a974-ff649d508142 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2" returned: 0 in 0.337s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:11 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 is being set with open permissions: ugo+rw Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:11 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 Sep 30 10:44:11 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:11 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46 Sep 30 10:44:11 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:11 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2" returned: 0 in 0.278s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:11 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.info Sep 30 10:44:11 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:11 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46" returned: 0 in 0.407s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:11 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46 Sep 30 10:44:11 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:12 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.info" returned: 0 in 0.280s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:12 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.info is being set with open permissions: ugo+rw Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:12 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.info Sep 30 10:44:12 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:12 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-cd99368f-8e69-4ca9-a6d4-582c98548e46" returned: 0 in 0.297s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Lock "cinder-quobyte-cd99368f-8e69-4ca9-a6d4-582c98548e46" released by "delete_volume" :: held 0.761s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Created reservations ['162e55e3-4888-446b-a490-71e099df5511', '657c9127-6e79-40cf-952d-bc93d9552e96', 'e8e48018-e33d-446d-a9f0-8b09068fe698', '5060a759-3992-4cda-90ee-891e2b1b800b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:12 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:12 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:12 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.info" returned: 0 in 0.269s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-946ff07f-570d-4ea1-978c-994a0e567c77 tempest-ProjectMemberTests-552928223 None] Create snapshot completed successfully Sep 30 10:44:12 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.249s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Deleted volume successfully. Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-a15c0d01-7bae-48f6-b148-a9e11c90af25 tempest-ProjectReaderTests-912697872 None] Lock "cinder-cd99368f-8e69-4ca9-a6d4-582c98548e46-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Flow 'volume_create_manager' (0b2c4a9a-06f1-4a00-9a7d-ce4b8d57788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe8156d-ef6f-49fb-82a4-660c615a694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe8156d-ef6f-49fb-82a4-660c615a694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335500277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997ab3f3-e3aa-4e50-942a-e74fa6099886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71867e622f4849ccad1cae8a12bf4b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:13Z,use_quota=True,user_id='18ce4676e77049cabfe48f1b642b2848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a61ceb-8e37-4e74-aabb-c3f3cea972fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a61ceb-8e37-4e74-aabb-c3f3cea972fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718c837a-8fac-478d-a7c6-9589dd006bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718c837a-8fac-478d-a7c6-9589dd006bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997ab3f3-e3aa-4e50-942a-e74fa6099886', 'volume_name': 'volume-997ab3f3-e3aa-4e50-942a-e74fa6099886', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f89757e-3d97-48a1-810e-e63b2d21066f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f89757e-3d97-48a1-810e-e63b2d21066f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d20ebc-90db-4e1c-b424-4df540637275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:12 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Volume 997ab3f3-e3aa-4e50-942a-e74fa6099886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997ab3f3-e3aa-4e50-942a-e74fa6099886', 'volume_size': 1} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335500277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997ab3f3-e3aa-4e50-942a-e74fa6099886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71867e622f4849ccad1cae8a12bf4b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:13Z,use_quota=True,user_id='18ce4676e77049cabfe48f1b642b2848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Creating volume 997ab3f3-e3aa-4e50-942a-e74fa6099886 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:12 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:12 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886 1073741824 Sep 30 10:44:12 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Lock "cinder-3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-a78afa3f-7c10-41bd-a974-ff649d508142" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-a78afa3f-7c10-41bd-a974-ff649d508142" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Deleting offline snapshot 3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 of volume a78afa3f-7c10-41bd-a974-ff649d508142 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] snapshot_file for this snap is: volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff175d03-754c-46d9-a67e-2322a7c69cf5]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:13 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 Sep 30 10:44:13 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:13 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886 1073741824" returned: 0 in 0.435s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:13 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886 Sep 30 10:44:13 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:13 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2" returned: 0 in 0.366s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a78afa3f-7c10-41bd-a974-ff649d508142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c912e65-32f1-4427-a1a9-460b036494dc]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:13 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886" returned: 0 in 0.253s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d20ebc-90db-4e1c-b424-4df540637275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997ab3f3-e3aa-4e50-942a-e74fa6099886', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90c5330-261c-4e4f-9243-534737a1e9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:13 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 Sep 30 10:44:13 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:13 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Volume volume-997ab3f3-e3aa-4e50-942a-e74fa6099886 (997ab3f3-e3aa-4e50-942a-e74fa6099886): created successfully Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90c5330-261c-4e4f-9243-534737a1e9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Flow 'volume_create_manager' (0b2c4a9a-06f1-4a00-9a7d-ce4b8d57788f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:13 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-42763c09-f6ef-4fc4-a80c-8113dca69fcd tempest-ProjectReaderTests-912697872 None] Created volume successfully. Sep 30 10:44:13 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Acquiring lock "cinder-997ab3f3-e3aa-4e50-942a-e74fa6099886-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142" returned: 0 in 0.366s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Lock "cinder-997ab3f3-e3aa-4e50-942a-e74fa6099886-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:13 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 Sep 30 10:44:13 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Acquiring lock "cinder-quobyte-997ab3f3-e3aa-4e50-942a-e74fa6099886" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Lock "cinder-quobyte-997ab3f3-e3aa-4e50-942a-e74fa6099886" acquired by "delete_volume" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ed5ce7-6799-427b-91ed-ddbbd92f9d8b]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:14 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886 Sep 30 10:44:14 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:14 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2" returned: 0 in 0.339s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:14 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2 Sep 30 10:44:14 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:14 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886" returned: 0 in 0.366s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:14 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886 Sep 30 10:44:14 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:14 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142.3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2" returned: 0 in 0.253s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2" released by "_delete_snapshot" :: held 1.426s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-a78afa3f-7c10-41bd-a974-ff649d508142" released by "delete_snapshot" :: held 1.448s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Created reservations ['8bf86de4-a5d7-4a1d-8094-0fa49ff66374', 'edab4afe-aa5c-4b43-a29b-2496bab0ec25', '22762e34-bef6-4114-90f6-ccd200cd16c3', 'c10bd5b7-a87b-486e-ad99-28cc2d51f402'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:14 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-997ab3f3-e3aa-4e50-942a-e74fa6099886" returned: 0 in 0.257s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:14 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Delete snapshot completed successfully. Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Lock "cinder-quobyte-997ab3f3-e3aa-4e50-942a-e74fa6099886" released by "delete_volume" :: held 0.673s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-893113bc-02a3-491a-88b2-ee25c6348179 tempest-ProjectMemberTests-552928223 None] Lock "cinder-3c8a6a3e-506f-4deb-8fb6-cd4ec54cfec2-delete_snapshot" released by "delete_snapshot" :: held 1.598s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Created reservations ['14410f44-efc2-4a70-90bf-b82c3b00e279', '2711eec0-f63a-4651-9d1a-0b39ee4ce7d1', '0927d6b2-76bf-4c0c-a636-49e63cea1d2f', '19e3f2f3-1073-4c47-a7a6-389363ac62f1'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:14 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:14 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:15 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.251s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:15 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Deleted volume successfully. Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-f492f2a6-6aa4-449d-9bba-5612e1c1dfa4 tempest-ProjectReaderTests-912697872 None] Lock "cinder-997ab3f3-e3aa-4e50-942a-e74fa6099886-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-a78afa3f-7c10-41bd-a974-ff649d508142-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Lock "cinder-a78afa3f-7c10-41bd-a974-ff649d508142-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-a78afa3f-7c10-41bd-a974-ff649d508142" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-a78afa3f-7c10-41bd-a974-ff649d508142" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[03798fc9-d916-4f7f-adea-33287673e7d6]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:15 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 Sep 30 10:44:15 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Flow 'volume_create_manager' (e070e256-5dbc-4a61-8fb7-00a61603dcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f6609c-0632-45cc-834e-3518b9c6839d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f6609c-0632-45cc-834e-3518b9c6839d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15784894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744a7d77-0a4b-4097-8940-23ac97d0a3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71867e622f4849ccad1cae8a12bf4b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:16Z,use_quota=True,user_id='18ce4676e77049cabfe48f1b642b2848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34970eec-9d2c-460b-b99a-011cb872e1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34970eec-9d2c-460b-b99a-011cb872e1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daacf424-be15-4484-8a78-4f65f2f0cd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daacf424-be15-4484-8a78-4f65f2f0cd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '744a7d77-0a4b-4097-8940-23ac97d0a3e8', 'volume_name': 'volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfe8eeb-575b-4aa8-b5d0-726ac8c6e3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfe8eeb-575b-4aa8-b5d0-726ac8c6e3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00008093-ebe1-492d-be3f-59451b80669c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:15 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Volume 744a7d77-0a4b-4097-8940-23ac97d0a3e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8', 'volume_size': 1} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15784894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744a7d77-0a4b-4097-8940-23ac97d0a3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71867e622f4849ccad1cae8a12bf4b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:16Z,use_quota=True,user_id='18ce4676e77049cabfe48f1b642b2848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Creating volume 744a7d77-0a4b-4097-8940-23ac97d0a3e8 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:15 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:15 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8 1073741824 Sep 30 10:44:15 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:15 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142" returned: 0 in 0.380s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:15 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:15 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142 Sep 30 10:44:15 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:16 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-a78afa3f-7c10-41bd-a974-ff649d508142" returned: 0 in 0.271s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-a78afa3f-7c10-41bd-a974-ff649d508142" released by "delete_volume" :: held 0.725s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:16 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8 1073741824" returned: 0 in 0.410s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Created reservations ['52a4b040-e1a7-4b11-a55c-6bbdff358981', '886a64a4-583f-40f7-b153-6123e2cae347', '42f19da0-b3c8-462b-ac49-e4d1c4e4b549', '43e1eff4-dad7-4d8d-9224-7405c85d6c9b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:16 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8 Sep 30 10:44:16 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:16 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:16 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:16 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8" returned: 0 in 0.261s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00008093-ebe1-492d-be3f-59451b80669c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4b4b19-c07d-43cc-a218-15497a70b331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:16 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Volume volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8 (744a7d77-0a4b-4097-8940-23ac97d0a3e8): created successfully Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4b4b19-c07d-43cc-a218-15497a70b331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:16 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Flow 'volume_create_manager' (e070e256-5dbc-4a61-8fb7-00a61603dcf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.265s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:16 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Deleted volume successfully. Sep 30 10:44:16 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-6904011b-110f-4d0c-b764-9ee9e7d709da tempest-ProjectReaderTests-912697872 None] Created volume successfully. Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c99ea76b-065e-4d5a-86a8-448005b92e7e tempest-ProjectMemberTests-552928223 None] Lock "cinder-a78afa3f-7c10-41bd-a974-ff649d508142-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Acquiring lock "cinder-744a7d77-0a4b-4097-8940-23ac97d0a3e8-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Lock "cinder-744a7d77-0a4b-4097-8940-23ac97d0a3e8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Acquiring lock "cinder-quobyte-744a7d77-0a4b-4097-8940-23ac97d0a3e8" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Lock "cinder-quobyte-744a7d77-0a4b-4097-8940-23ac97d0a3e8" acquired by "delete_volume" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3c82b5-3b7d-4845-a9c6-fb00b289698a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:16 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8 Sep 30 10:44:16 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (79d95295-87ca-445f-815c-eb73953b157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91f28db-51c1-4c28-b072-bc8cc9afb967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91f28db-51c1-4c28-b072-bc8cc9afb967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150559800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:17Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f397ae6f-e8cd-4f7c-a4fb-d47ceba4c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f397ae6f-e8cd-4f7c-a4fb-d47ceba4c20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f26317-5b74-4b79-9cc8-9e719f9b8048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f26317-5b74-4b79-9cc8-9e719f9b8048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f', 'volume_name': 'volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f790935-0b42-4039-84b1-57e746f0acda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f790935-0b42-4039-84b1-57e746f0acda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96aa7c47-650e-463f-89b4-1da271a4d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:16 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Volume dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f', 'volume_size': 1} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150559800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:17Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Creating volume dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:16 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:16 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:16 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f 1073741824 Sep 30 10:44:16 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:17 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8" returned: 0 in 0.386s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:17 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8 Sep 30 10:44:17 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:17 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-744a7d77-0a4b-4097-8940-23ac97d0a3e8" returned: 0 in 0.256s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:17 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f 1073741824" returned: 0 in 0.439s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Lock "cinder-quobyte-744a7d77-0a4b-4097-8940-23ac97d0a3e8" released by "delete_volume" :: held 0.699s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:17 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f Sep 30 10:44:17 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Created reservations ['3820cb43-7f7f-4319-929c-71d8e9bcf392', '228d990f-e401-4c78-be27-5e79acd43267', '27f82568-2015-4f01-bbf5-ad1c29f237d9', '8891b07f-19ab-4fdd-9e38-ca269bb975b9'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:17 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:17 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:17 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" returned: 0 in 0.289s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96aa7c47-650e-463f-89b4-1da271a4d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15db9a1d-cf9c-4ac0-93aa-c5632c2159ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:17 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Volume volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f (dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f): created successfully Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15db9a1d-cf9c-4ac0-93aa-c5632c2159ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (79d95295-87ca-445f-815c-eb73953b157a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:17 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a9c3d83a-9850-4ad0-8746-cb826bd5ff3d tempest-ProjectMemberTests-552928223 None] Created volume successfully. Sep 30 10:44:17 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.302s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:17 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Deleted volume successfully. Sep 30 10:44:17 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-817c10a9-1921-42cb-8243-78b9ae457f00 tempest-ProjectReaderTests-912697872 None] Lock "cinder-744a7d77-0a4b-4097-8940-23ac97d0a3e8-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:18 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Creating offline snapshot 7fba28c0-e881-492c-bb57-9309b82d1755 of volume dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:44:18 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[246d57d0-bdb2-4c57-8ba9-de011133fb1a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:18 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f Sep 30 10:44:18 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:18 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" returned: 0 in 0.374s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:18 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 1G Sep 30 10:44:18 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:18 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 1G" returned: 0 in 0.452s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:18 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:18 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 Sep 30 10:44:18 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:19 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755" returned: 0 in 0.307s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:19 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 is being set with open permissions: ugo+rw Sep 30 10:44:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:19 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 Sep 30 10:44:19 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:19 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755" returned: 0 in 0.269s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:19 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.info Sep 30 10:44:19 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:19 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.info" returned: 0 in 0.262s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:19 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.info is being set with open permissions: ugo+rw Sep 30 10:44:19 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:19 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.info Sep 30 10:44:19 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:20 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.info" returned: 0 in 0.251s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:20 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:20 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-470b15ca-7884-4634-b3f3-37a7f5eccf36 tempest-ProjectMemberTests-552928223 None] Create snapshot completed successfully Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-7fba28c0-e881-492c-bb57-9309b82d1755-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Lock "cinder-7fba28c0-e881-492c-bb57-9309b82d1755-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-7fba28c0-e881-492c-bb57-9309b82d1755" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-7fba28c0-e881-492c-bb57-9309b82d1755" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Deleting offline snapshot 7fba28c0-e881-492c-bb57-9309b82d1755 of volume dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] snapshot_file for this snap is: volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c641e2-b2ec-46a8-87ae-66f22091a303]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:21 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 Sep 30 10:44:21 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:21 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755" returned: 0 in 0.418s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca685d5-bd79-4f54-870d-636b9afb91ac]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:21 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:21 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f Sep 30 10:44:21 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:22 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" returned: 0 in 0.377s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:22 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 Sep 30 10:44:22 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:22 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755" returned: 0 in 0.335s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:22 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755 Sep 30 10:44:22 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:22 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:22 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f.7fba28c0-e881-492c-bb57-9309b82d1755" returned: 0 in 0.267s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-7fba28c0-e881-492c-bb57-9309b82d1755" released by "_delete_snapshot" :: held 1.505s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" released by "delete_snapshot" :: held 1.530s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:22 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Created reservations ['67126c98-03dd-440b-a60e-066f8201fd27', '8491ff35-4342-453a-8770-8852945f7e3f', '08122110-22cd-41a6-8d36-6e4a9064b303', 'ca15672c-73b2-4133-a8e0-a308a1f4a0c5'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:22 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Delete snapshot completed successfully. Sep 30 10:44:22 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-999ffb81-c3ee-48d9-93b4-f9a30910b907 tempest-ProjectMemberTests-552928223 None] Lock "cinder-7fba28c0-e881-492c-bb57-9309b82d1755-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Lock "cinder-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:23 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:23 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e81714-5fcd-45fc-a38a-7a30d9871987]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:23 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f Sep 30 10:44:23 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:23 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" returned: 0 in 0.404s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:23 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:24 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f Sep 30 10:44:24 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:24 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" returned: 0 in 0.246s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f" released by "delete_volume" :: held 0.732s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Created reservations ['3cccb8c7-70cf-4d33-9c33-61b568cba48a', '2a122a2b-081b-4ee4-a356-3dc5b5e8ac88', '364a182c-db63-41dc-9c7d-02b100fda631', '58a5a6c0-45a7-44f1-93fb-8fa7b2d7987b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:24 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:24 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:24 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.253s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:24 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Deleted volume successfully. Sep 30 10:44:24 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-440aa1cb-1419-4e92-8553-3f12dc27390f tempest-ProjectMemberTests-552928223 None] Lock "cinder-dcdb2aa7-0ba1-4885-aff3-4d632cf87f3f-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (00313d1e-ac77-4ae5-93f4-048e09f08a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a8488f-a23b-4dd9-9ac6-0992c1d371ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a8488f-a23b-4dd9-9ac6-0992c1d371ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493309888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:25Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b2efc9-a3c9-4036-a40d-eafe5ae6c6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b2efc9-a3c9-4036-a40d-eafe5ae6c6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2940570-cc38-4c24-baf8-f304e827c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2940570-cc38-4c24-baf8-f304e827c837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba', 'volume_name': 'volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a242d0-fc14-4b65-9ca0-5311ae503612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a242d0-fc14-4b65-9ca0-5311ae503612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17dca205-6617-4f49-aed6-0fb1d4a05f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:25 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Volume 1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba', 'volume_size': 1} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493309888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:25Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Creating volume 1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:25 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:25 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba 1073741824 Sep 30 10:44:25 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:25 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba 1073741824" returned: 0 in 0.522s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:25 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:25 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba Sep 30 10:44:25 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:26 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" returned: 0 in 0.285s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:26 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:26 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17dca205-6617-4f49-aed6-0fb1d4a05f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ec19da-6568-493c-a062-bf85093f5fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:26 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Volume volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba (1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba): created successfully Sep 30 10:44:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ec19da-6568-493c-a062-bf85093f5fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:26 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (00313d1e-ac77-4ae5-93f4-048e09f08a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:26 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-98b01bcf-e3a5-4ee8-8774-71d14ac18065 tempest-ProjectMemberTests-552928223 None] Created volume successfully. Sep 30 10:44:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:27 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Creating offline snapshot 8f8cc290-9276-4951-9639-3b60ce9b6d77 of volume 1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:44:27 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a74de3-13e6-47e9-a842-ae2c270767aa]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:27 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba Sep 30 10:44:27 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:27 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" returned: 0 in 0.381s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:27 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:27 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 1G Sep 30 10:44:27 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:28 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 1G" returned: 0 in 0.483s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:28 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 Sep 30 10:44:28 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:28 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77" returned: 0 in 0.385s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:28 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 is being set with open permissions: ugo+rw Sep 30 10:44:28 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:28 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 Sep 30 10:44:28 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:29 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77" returned: 0 in 0.270s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:29 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.info Sep 30 10:44:29 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:29 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.info" returned: 0 in 0.308s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:29 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.info is being set with open permissions: ugo+rw Sep 30 10:44:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:29 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.info Sep 30 10:44:29 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:29 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.info" returned: 0 in 0.294s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:29 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:29 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f2663831-52d5-4d4d-b5af-0c00eaa3a819 tempest-ProjectMemberTests-552928223 None] Create snapshot completed successfully Sep 30 10:44:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-8f8cc290-9276-4951-9639-3b60ce9b6d77-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Lock "cinder-8f8cc290-9276-4951-9639-3b60ce9b6d77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-8f8cc290-9276-4951-9639-3b60ce9b6d77" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:30 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-8f8cc290-9276-4951-9639-3b60ce9b6d77" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Deleting offline snapshot 8f8cc290-9276-4951-9639-3b60ce9b6d77 of volume 1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:44:30 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] snapshot_file for this snap is: volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:44:30 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef07b6-b06e-4c3f-9f66-d96f1c095f85]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:30 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:30 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 Sep 30 10:44:30 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:31 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77" returned: 0 in 0.368s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:31 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:44:31 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cc7e6e-3eb3-42be-9ced-d03d68fb208a]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:31 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba Sep 30 10:44:31 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:31 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:31 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 Sep 30 10:44:31 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:31 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77" returned: 0 in 0.361s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:31 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:31 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77 Sep 30 10:44:31 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:32 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba.8f8cc290-9276-4951-9639-3b60ce9b6d77" returned: 0 in 0.251s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-8f8cc290-9276-4951-9639-3b60ce9b6d77" released by "_delete_snapshot" :: held 1.472s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" released by "delete_snapshot" :: held 1.494s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Created reservations ['abd4ffa4-64d6-4ebf-abda-095222bc1359', '2406773c-6508-4f29-b4b6-f8b00411182d', 'b455461f-4ac1-48ca-a82e-711c28ec4e77', 'd6c9b74a-cf55-4975-bfa9-2d6a484934ec'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:32 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Delete snapshot completed successfully. Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-02ba1f36-65b4-4593-ae3a-b636db4b81f2 tempest-ProjectMemberTests-552928223 None] Lock "cinder-8f8cc290-9276-4951-9639-3b60ce9b6d77-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Lock "cinder-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fd2cad-60f9-4623-ada2-f8a0fdb34e2d]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:32 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:33 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba Sep 30 10:44:33 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:33 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" returned: 0 in 0.398s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:33 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba Sep 30 10:44:33 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:33 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" returned: 0 in 0.288s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba" released by "delete_volume" :: held 0.759s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Created reservations ['a91cb77a-cc35-4452-a586-c0be9ec18ad0', '6e9079cd-d710-4b78-8708-8c2de7ac179e', 'a10dfb1a-a6ba-472e-ae1a-2b08605ecc7f', '11824d12-b902-4753-9b26-b999216ffa0e'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:33 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:33 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:33 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:34 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.290s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:34 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Deleted volume successfully. Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-ec72804c-4706-4017-a82a-32de22893290 tempest-ProjectMemberTests-552928223 None] Lock "cinder-1d4316b8-8d3e-4fc2-b70d-5fffe618c5ba-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (5256967e-d270-4c12-aabb-7f714e70e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7950128-a993-4a22-a65a-73f62c20fb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7950128-a993-4a22-a65a-73f62c20fb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092143834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965c75d8-cc6a-41c4-a51b-f7d800e4579d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:34Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32079909-49d9-405a-a7da-74f92f214d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32079909-49d9-405a-a7da-74f92f214d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ea4a0b-0a93-4743-8765-68fc9ae39b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ea4a0b-0a93-4743-8765-68fc9ae39b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965c75d8-cc6a-41c4-a51b-f7d800e4579d', 'volume_name': 'volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65c1294-295e-4c23-a991-5d7fef220ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65c1294-295e-4c23-a991-5d7fef220ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e18cfec-cc2f-425d-9263-26033db01991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:34 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Volume 965c75d8-cc6a-41c4-a51b-f7d800e4579d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d', 'volume_size': 1} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092143834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965c75d8-cc6a-41c4-a51b-f7d800e4579d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:34Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Creating volume 965c75d8-cc6a-41c4-a51b-f7d800e4579d {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:34 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:34 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:34 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d 1073741824 Sep 30 10:44:34 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:35 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d 1073741824" returned: 0 in 0.541s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:35 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d Sep 30 10:44:35 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:35 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d" returned: 0 in 0.302s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:35 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:35 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e18cfec-cc2f-425d-9263-26033db01991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf773d7-1a57-4261-b353-a6cff5b11a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:35 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Volume volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d (965c75d8-cc6a-41c4-a51b-f7d800e4579d): created successfully Sep 30 10:44:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf773d7-1a57-4261-b353-a6cff5b11a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:35 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (5256967e-d270-4c12-aabb-7f714e70e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:35 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-53449ee3-d423-46e3-a1e5-289e38fb25ff tempest-ProjectMemberTests-552928223 None] Created volume successfully. Sep 30 10:44:36 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:INSERT=63,cinder:UPDATE=220,cinder:SELECT=164,cinder:DELETE=23 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:44:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:36 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Creating offline snapshot 06021a69-20ad-4560-b7a2-78f67e3c60b5 of volume 965c75d8-cc6a-41c4-a51b-f7d800e4579d {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:44:36 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbdcd87-c6d7-4325-8b42-fe890812fa08]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:36 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:36 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d Sep 30 10:44:36 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:37 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:37 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:37 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d" returned: 0 in 0.379s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:37 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 1G Sep 30 10:44:37 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:37 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.349s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 10:44:37 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 1G" returned: 0 in 0.548s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:37 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 Sep 30 10:44:37 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:38 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5" returned: 0 in 0.351s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:38 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 is being set with open permissions: ugo+rw Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:38 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 Sep 30 10:44:38 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:38 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5" returned: 0 in 0.254s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=164,cinder:UPDATE=213,cinder:INSERT=52,cinder:DELETE=12 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:38 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.info Sep 30 10:44:38 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Flow 'volume_create_manager' (9ad180a6-c5a5-4cbc-ab88-7ad06cdcdae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a212a1c-a21e-4b8b-aa31-413fd7f364bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:38 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a212a1c-a21e-4b8b-aa31-413fd7f364bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-856250853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c3d52b-7470-419d-84e0-cdc2996a87bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1d4dfcda1f4880b7f539fd84826c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:39Z,use_quota=True,user_id='d34936ad172b4179a8728f8572647d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324613c8-5222-4e43-88d2-868125bd6269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324613c8-5222-4e43-88d2-868125bd6269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31338e2-659f-4676-a3c2-36e38b157f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31338e2-659f-4676-a3c2-36e38b157f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c3d52b-7470-419d-84e0-cdc2996a87bd', 'volume_name': 'volume-09c3d52b-7470-419d-84e0-cdc2996a87bd', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc6c8b5-8f7a-4bb3-a36e-c8be482dfd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc6c8b5-8f7a-4bb3-a36e-c8be482dfd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ce39ea-423c-411a-bd52-cb6ed962adef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:38 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Volume 09c3d52b-7470-419d-84e0-cdc2996a87bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c3d52b-7470-419d-84e0-cdc2996a87bd', 'volume_size': 1} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.info" returned: 0 in 0.304s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:38 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.info is being set with open permissions: ugo+rw Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:38 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.info Sep 30 10:44:38 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:38 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.info" returned: 0 in 0.242s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-856250853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c3d52b-7470-419d-84e0-cdc2996a87bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1d4dfcda1f4880b7f539fd84826c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:39Z,use_quota=True,user_id='d34936ad172b4179a8728f8572647d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Creating volume 09c3d52b-7470-419d-84e0-cdc2996a87bd {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:38 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:38 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:39 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd 1073741824 Sep 30 10:44:39 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c6f227bc-5861-49dc-8349-7e169ba26359 tempest-ProjectMemberTests-552928223 None] Create snapshot completed successfully Sep 30 10:44:39 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd 1073741824" returned: 0 in 0.400s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:39 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd Sep 30 10:44:39 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:39 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd" returned: 0 in 0.239s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ce39ea-423c-411a-bd52-cb6ed962adef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c3d52b-7470-419d-84e0-cdc2996a87bd', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68250d5d-8a1a-4b0c-b89c-6eb535a27172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:39 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Volume volume-09c3d52b-7470-419d-84e0-cdc2996a87bd (09c3d52b-7470-419d-84e0-cdc2996a87bd): created successfully Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68250d5d-8a1a-4b0c-b89c-6eb535a27172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Flow 'volume_create_manager' (9ad180a6-c5a5-4cbc-ab88-7ad06cdcdae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:39 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-24734a9c-518e-4358-b5f0-9d1aac0e4828 tempest-SnapshotDependencyTests-483117274 None] Created volume successfully. Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-06021a69-20ad-4560-b7a2-78f67e3c60b5-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Lock "cinder-06021a69-20ad-4560-b7a2-78f67e3c60b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-965c75d8-cc6a-41c4-a51b-f7d800e4579d" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-965c75d8-cc6a-41c4-a51b-f7d800e4579d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:39 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-06021a69-20ad-4560-b7a2-78f67e3c60b5" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-06021a69-20ad-4560-b7a2-78f67e3c60b5" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Deleting offline snapshot 06021a69-20ad-4560-b7a2-78f67e3c60b5 of volume 965c75d8-cc6a-41c4-a51b-f7d800e4579d {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] snapshot_file for this snap is: volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd6eb7b-d732-4a09-87f3-cd4d30e3d79f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:40 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 Sep 30 10:44:40 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:40 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5" returned: 0 in 0.355s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3237841f-9971-46e2-bd64-37fee7a88670]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:40 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d Sep 30 10:44:40 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:40 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d" returned: 0 in 0.363s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:40 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 Sep 30 10:44:40 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Creating offline snapshot d03e9a3d-3ffc-494b-8021-9fd1b18da645 of volume 09c3d52b-7470-419d-84e0-cdc2996a87bd {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f14f6c0-272f-4915-a8f8-be5b387fa98c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:40 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:41 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd Sep 30 10:44:41 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:41 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5" returned: 0 in 0.347s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:41 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5 Sep 30 10:44:41 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:41 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd" returned: 0 in 0.378s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:41 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 1G Sep 30 10:44:41 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:41 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d.06021a69-20ad-4560-b7a2-78f67e3c60b5" returned: 0 in 0.257s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-06021a69-20ad-4560-b7a2-78f67e3c60b5" released by "_delete_snapshot" :: held 1.428s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-965c75d8-cc6a-41c4-a51b-f7d800e4579d" released by "delete_snapshot" :: held 1.496s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Created reservations ['06b2500d-1f2f-47d2-a03f-c945657b0182', '58cba2a5-81a4-406f-865a-6182135c63ad', '63238480-f5fd-429b-b364-35d103f9d6e4', 'b5bc68f0-86f5-4e68-83df-4fb2d0432d13'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:41 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Delete snapshot completed successfully. Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-fbfc3078-3c78-4f16-befe-4f6488a7943e tempest-ProjectMemberTests-552928223 None] Lock "cinder-06021a69-20ad-4560-b7a2-78f67e3c60b5-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:41 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 1G" returned: 0 in 0.413s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:41 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c3d52b-7470-419d-84e0-cdc2996a87bd -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:41 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c3d52b-7470-419d-84e0-cdc2996a87bd -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 Sep 30 10:44:41 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-965c75d8-cc6a-41c4-a51b-f7d800e4579d-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:42 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c3d52b-7470-419d-84e0-cdc2996a87bd -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645" returned: 0 in 0.332s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:42 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 is being set with open permissions: ugo+rw Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Lock "cinder-965c75d8-cc6a-41c4-a51b-f7d800e4579d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:42 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 Sep 30 10:44:42 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-965c75d8-cc6a-41c4-a51b-f7d800e4579d" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-965c75d8-cc6a-41c4-a51b-f7d800e4579d" acquired by "delete_volume" :: waited 0.021s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc693e94-d506-45ff-8613-f3528f071d28]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:42 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d Sep 30 10:44:42 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:42 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645" returned: 0 in 0.270s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:42 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.info Sep 30 10:44:42 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:42 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d" returned: 0 in 0.407s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:42 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d Sep 30 10:44:42 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:42 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.info" returned: 0 in 0.309s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:42 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.info is being set with open permissions: ugo+rw Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:42 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.info Sep 30 10:44:42 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:42 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-965c75d8-cc6a-41c4-a51b-f7d800e4579d" returned: 0 in 0.257s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-965c75d8-cc6a-41c4-a51b-f7d800e4579d" released by "delete_volume" :: held 0.728s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:42 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Created reservations ['cb11c987-8272-489a-bd25-9ea22efbcd56', '9a467d45-46a8-4b05-b269-4a328c10da4f', '7b939e69-3e68-4928-bed7-c15a29928f0f', '604c5522-6670-4ba2-b8a2-f9ef08d20fd9'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:43 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.info" returned: 0 in 0.270s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-9cf6d562-0162-4dea-9e58-9c0435ae4b6c tempest-SnapshotDependencyTests-483117274 None] Create snapshot completed successfully Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:43 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:43 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:43 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.248s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:43 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Deleted volume successfully. Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-040770dc-f530-4927-8c25-f71d8d0ca7b6 tempest-ProjectMemberTests-552928223 None] Lock "cinder-965c75d8-cc6a-41c4-a51b-f7d800e4579d-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (1cca423e-fcab-4f0a-abe4-dbb1a459e52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b9c068-485e-460e-8c91-8b5d631fd374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b9c068-485e-460e-8c91-8b5d631fd374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457691176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dea2b0c-bda6-48b2-876c-8d791d1cbc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:44Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13245b35-7a80-457b-8d2b-dcbd8d8c33ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13245b35-7a80-457b-8d2b-dcbd8d8c33ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849ac6f1-7747-4048-8acc-7472823e2ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849ac6f1-7747-4048-8acc-7472823e2ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dea2b0c-bda6-48b2-876c-8d791d1cbc18', 'volume_name': 'volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535a6ea6-9ea3-4902-83cc-67b50fdaabdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535a6ea6-9ea3-4902-83cc-67b50fdaabdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29da9556-5ca0-41a2-97ab-31b7b415ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:43 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Volume 0dea2b0c-bda6-48b2-876c-8d791d1cbc18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18', 'volume_size': 1} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457691176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dea2b0c-bda6-48b2-876c-8d791d1cbc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:44Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Creating volume 0dea2b0c-bda6-48b2-876c-8d791d1cbc18 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:43 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:43 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:43 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 1073741824 Sep 30 10:44:43 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:44 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 1073741824" returned: 0 in 0.454s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:44 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 Sep 30 10:44:44 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:44 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" returned: 0 in 0.277s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29da9556-5ca0-41a2-97ab-31b7b415ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cb4851-7902-454b-a6cf-21f485e408ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:44 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Volume volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 (0dea2b0c-bda6-48b2-876c-8d791d1cbc18): created successfully Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cb4851-7902-454b-a6cf-21f485e408ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (1cca423e-fcab-4f0a-abe4-dbb1a459e52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:44 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-777fd29d-9a7e-44e7-b0b9-784c2bf0f200 tempest-ProjectMemberTests-552928223 None] Created volume successfully. Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Flow 'volume_create_manager' (8503a5b0-dfb2-48c3-9cae-5e4a39093573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c966680f-9214-41ad-8be8-7ea596ff7f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c966680f-9214-41ad-8be8-7ea596ff7f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7062dbd9-8fce-4f47-8f13-c5d23fa82a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1d4dfcda1f4880b7f539fd84826c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d03e9a3d-3ffc-494b-8021-9fd1b18da645,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:45Z,use_quota=True,user_id='d34936ad172b4179a8728f8572647d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1e3337-b51b-48b8-8281-d3ecd25fc0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1e3337-b51b-48b8-8281-d3ecd25fc0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec392ca-05c8-4472-9408-d633e73d294a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec392ca-05c8-4472-9408-d633e73d294a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7062dbd9-8fce-4f47-8f13-c5d23fa82a42', 'volume_name': 'volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42', 'volume_size': 1, 'snapshot_id': 'd03e9a3d-3ffc-494b-8021-9fd1b18da645'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c14182-54fb-4bab-b552-fa0a8087a742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c14182-54fb-4bab-b552-fa0a8087a742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed53147d-0327-4a18-8ed9-6336ea216cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:44 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Volume 7062dbd9-8fce-4f47-8f13-c5d23fa82a42: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42', 'volume_size': 1, 'snapshot_id': 'd03e9a3d-3ffc-494b-8021-9fd1b18da645'} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "cinder-quobyte-d03e9a3d-3ffc-494b-8021-9fd1b18da645-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" by "_create_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-d03e9a3d-3ffc-494b-8021-9fd1b18da645-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Creating volume 7062dbd9-8fce-4f47-8f13-c5d23fa82a42 from snapshot d03e9a3d-3ffc-494b-8021-9fd1b18da645 {{(pid=87013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "cinder-quobyte-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" by "_copy_volume_from_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] snapshot: d03e9a3d-3ffc-494b-8021-9fd1b18da645, volume: 7062dbd9-8fce-4f47-8f13-c5d23fa82a42, {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1284c4-1750-40aa-8ad5-a4ebb6e2be6c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:44 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:45 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 Sep 30 10:44:45 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:45 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645" returned: 0 in 0.357s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09c3d52b-7470-419d-84e0-cdc2996a87bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:44:45 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cfe231-88c8-42f0-bfdf-85ce8d0047f1]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:45 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd Sep 30 10:44:45 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:45 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 10:44:45 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Creating direct copy from snapshot {{(pid=87013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 10:44:45 devstack cinder-volume[87013]: DEBUG cinder.utils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Path /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 not found in is_blk_device check {{(pid=87013) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 10:44:45 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:45 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 Sep 30 10:44:45 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:51 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" returned: 0 in 5.960s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG cinder.image.image_utils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Image conversion details: src /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 {{(pid=87013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 10:44:51 devstack cinder-volume[87013]: INFO cinder.image.image_utils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Converted 1024.00 MB image at 171.76 MB/s Sep 30 10:44:51 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 is being set with open permissions: ugo+rw Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:51 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 Sep 30 10:44:51 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:51 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" returned: 0 in 0.244s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" released by "_copy_volume_from_snapshot" :: held 7.039s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-d03e9a3d-3ffc-494b-8021-9fd1b18da645-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" released by "_create_volume_from_snapshot" :: held 7.106s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.125s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Creating offline snapshot bd2b5213-a5ef-40d3-9975-069df9afd57c of volume 0dea2b0c-bda6-48b2-876c-8d791d1cbc18 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed53147d-0327-4a18-8ed9-6336ea216cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42', 'volume_size': 1, 'snapshot_id': 'd03e9a3d-3ffc-494b-8021-9fd1b18da645'}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4457b421-61e6-45e0-8c59-9ca98fdbfd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab0a79-817f-47ca-89c6-816973ae8fc0]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:51 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Volume volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 (7062dbd9-8fce-4f47-8f13-c5d23fa82a42): created successfully Sep 30 10:44:51 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4457b421-61e6-45e0-8c59-9ca98fdbfd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Flow 'volume_create_manager' (8503a5b0-dfb2-48c3-9cae-5e4a39093573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:52 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c30ccbcc-3a7e-414f-b0be-97920ad25506 tempest-SnapshotDependencyTests-483117274 None] Created volume successfully. Sep 30 10:44:52 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 Sep 30 10:44:52 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:52 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" returned: 0 in 0.367s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:52 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c 1G Sep 30 10:44:52 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "cinder-d03e9a3d-3ffc-494b-8021-9fd1b18da645-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-d03e9a3d-3ffc-494b-8021-9fd1b18da645-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "cinder-quobyte-09c3d52b-7470-419d-84e0-cdc2996a87bd" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-09c3d52b-7470-419d-84e0-cdc2996a87bd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "cinder-quobyte-d03e9a3d-3ffc-494b-8021-9fd1b18da645" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-d03e9a3d-3ffc-494b-8021-9fd1b18da645" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Deleting offline snapshot d03e9a3d-3ffc-494b-8021-9fd1b18da645 of volume 09c3d52b-7470-419d-84e0-cdc2996a87bd {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] snapshot_file for this snap is: volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1b33b2-b843-40d7-b617-ab853b282259]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:52 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 Sep 30 10:44:52 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:52 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c 1G" returned: 0 in 0.404s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:52 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c Sep 30 10:44:52 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:52 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645" returned: 0 in 0.367s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09c3d52b-7470-419d-84e0-cdc2996a87bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac7395c-da3d-4bc2-ada3-81b2bc3994fb]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:52 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:53 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd Sep 30 10:44:53 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:53 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c" returned: 0 in 0.308s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:53 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c is being set with open permissions: ugo+rw Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:53 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c Sep 30 10:44:53 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:53 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c" returned: 0 in 0.242s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:53 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.info Sep 30 10:44:53 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:53 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd" returned: 0 in 0.549s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:53 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 Sep 30 10:44:53 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:53 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.info" returned: 0 in 0.261s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:53 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.info is being set with open permissions: ugo+rw Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:53 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.info Sep 30 10:44:53 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:53 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645" returned: 0 in 0.353s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:53 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645 Sep 30 10:44:53 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:53 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.info" returned: 0 in 0.271s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:53 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:53 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-c0f1a070-2d8f-443e-a70f-fa1af127d050 tempest-ProjectMemberTests-552928223 None] Create snapshot completed successfully Sep 30 10:44:54 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd.d03e9a3d-3ffc-494b-8021-9fd1b18da645" returned: 0 in 0.248s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-d03e9a3d-3ffc-494b-8021-9fd1b18da645" released by "_delete_snapshot" :: held 1.626s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-09c3d52b-7470-419d-84e0-cdc2996a87bd" released by "delete_snapshot" :: held 1.652s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Created reservations ['aeaa0b86-462e-42a3-8c29-295ccf282c44', '058198da-d57b-46cb-8586-9e674e9854c0', '5b0c734b-454f-44b2-8a2a-ac1b72e66491', 'e6924148-441a-48b0-83af-14a9df55d2dd'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:54 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Delete snapshot completed successfully. Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-177ee534-d59d-49e7-b6dc-dc431bc45055 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-d03e9a3d-3ffc-494b-8021-9fd1b18da645-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-bd2b5213-a5ef-40d3-9975-069df9afd57c-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Lock "cinder-bd2b5213-a5ef-40d3-9975-069df9afd57c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-bd2b5213-a5ef-40d3-9975-069df9afd57c" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-bd2b5213-a5ef-40d3-9975-069df9afd57c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Deleting offline snapshot bd2b5213-a5ef-40d3-9975-069df9afd57c of volume 0dea2b0c-bda6-48b2-876c-8d791d1cbc18 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] snapshot_file for this snap is: volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b7ac82-d8da-48a1-b6ce-61c1083a9547]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:54 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c Sep 30 10:44:54 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "cinder-09c3d52b-7470-419d-84e0-cdc2996a87bd-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-09c3d52b-7470-419d-84e0-cdc2996a87bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "cinder-quobyte-09c3d52b-7470-419d-84e0-cdc2996a87bd" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-09c3d52b-7470-419d-84e0-cdc2996a87bd" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[630d016c-23e4-4fab-8bf8-54ae868e51a1]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:54 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c" returned: 0 in 0.370s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4130ada9-6812-4b9f-b44c-43df3f878169]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:54 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:54 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd Sep 30 10:44:54 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:54 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 Sep 30 10:44:54 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:55 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd" returned: 0 in 0.377s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:55 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd Sep 30 10:44:55 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:55 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" returned: 0 in 0.371s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:55 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c Sep 30 10:44:55 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:55 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-09c3d52b-7470-419d-84e0-cdc2996a87bd" returned: 0 in 0.262s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-09c3d52b-7470-419d-84e0-cdc2996a87bd" released by "delete_volume" :: held 0.701s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Created reservations ['4b2a3bc7-aa83-413f-a735-dabeaf1a39f8', '623ccf75-484a-47e4-913d-5e35ff8f4ab0', '7641e26e-293e-47ee-9983-2a189ad608f6', '2937be6d-8d03-4c9e-80ef-b2a1e67d8d3b'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:55 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:55 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:55 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c" returned: 0 in 0.357s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:55 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c Sep 30 10:44:55 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:55 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.259s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:55 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Deleted volume successfully. Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "cinder-7062dbd9-8fce-4f47-8f13-c5d23fa82a42-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:55 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18.bd2b5213-a5ef-40d3-9975-069df9afd57c" returned: 0 in 0.261s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-91968db9-0a08-4fe7-9273-9c629fa5c3f3 tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-09c3d52b-7470-419d-84e0-cdc2996a87bd-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-7062dbd9-8fce-4f47-8f13-c5d23fa82a42-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-bd2b5213-a5ef-40d3-9975-069df9afd57c" released by "_delete_snapshot" :: held 1.466s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" released by "delete_snapshot" :: held 1.493s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "cinder-quobyte-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" acquired by "delete_volume" :: waited 0.016s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eec7a7-4ec4-421b-8b54-8aba60b185ab]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:55 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Created reservations ['aef48f28-efc1-428f-8d5e-2e89582336d5', '0be7fc33-19a2-43c0-8711-c1cb38f0c4d1', '9159a4fe-61e7-4e5b-b6a4-a7e4d8faec32', '46ca56ee-0b4f-4af4-9f15-64c7d0339b69'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:56 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Delete snapshot completed successfully. Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-67dafac6-3f8c-4081-86c2-386d6cff7b78 tempest-ProjectMemberTests-552928223 None] Lock "cinder-bd2b5213-a5ef-40d3-9975-069df9afd57c-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:56 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 Sep 30 10:44:56 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:56 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" returned: 0 in 0.368s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:56 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42 Sep 30 10:44:56 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-0dea2b0c-bda6-48b2-876c-8d791d1cbc18-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Lock "cinder-0dea2b0c-bda6-48b2-876c-8d791d1cbc18-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:56 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" returned: 0 in 0.265s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" acquired by "delete_volume" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-quobyte-7062dbd9-8fce-4f47-8f13-c5d23fa82a42" released by "delete_volume" :: held 0.710s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5019fe-e4ad-471c-9f6a-e770535566d4]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Created reservations ['2ff6f55f-6b23-4db4-ba50-547a46f15e9e', '224006d8-fc84-49bc-adc0-9d368de67a9d', '8ce94867-4fc4-418b-b28e-46afdacd19e5', 'a1daa777-7094-4664-9909-263e8077b271'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:56 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:56 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:56 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:56 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:56 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.262s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:56 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:57 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Deleted volume successfully. Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" returned: 0 in 0.391s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:57 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18 Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-3d94b89a-b236-4ee7-bafb-80ea1ece3cdb tempest-SnapshotDependencyTests-483117274 None] Lock "cinder-7062dbd9-8fce-4f47-8f13-c5d23fa82a42-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:57 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:57 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" returned: 0 in 0.269s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-0dea2b0c-bda6-48b2-876c-8d791d1cbc18" released by "delete_volume" :: held 0.727s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Created reservations ['c09bfba8-234b-4135-9744-8e261520250f', '391ef414-2fd7-4918-a3ca-2eaf67e6808c', '996291c6-4978-4961-bf52-9ffa4baa4a65', 'b60bbe1c-2cb6-4e63-a7a6-77943dd903b7'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:57 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:44:57 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:57 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.289s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:44:57 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Deleted volume successfully. Sep 30 10:44:57 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-03cd1c7c-de2e-4027-bcac-129102cd67e7 tempest-ProjectMemberTests-552928223 None] Lock "cinder-0dea2b0c-bda6-48b2-876c-8d791d1cbc18-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (08edf4e0-01ca-4037-a7fb-378757932477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53196625-ea25-461f-a5c3-5df0a067acb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53196625-ea25-461f-a5c3-5df0a067acb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310071503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c517cd11-866c-49eb-bc4c-ebf39784d181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:58Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b80a10-e09c-40f7-ad58-71fc349f0587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b80a10-e09c-40f7-ad58-71fc349f0587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ed9938-bfeb-4c6c-8204-0122bfd4aecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ed9938-bfeb-4c6c-8204-0122bfd4aecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c517cd11-866c-49eb-bc4c-ebf39784d181', 'volume_name': 'volume-c517cd11-866c-49eb-bc4c-ebf39784d181', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f58730-8a13-489f-be5c-7d4b803d6756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f58730-8a13-489f-be5c-7d4b803d6756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b783f4-fa3d-4f86-908d-0018e561867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:58 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Volume c517cd11-866c-49eb-bc4c-ebf39784d181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c517cd11-866c-49eb-bc4c-ebf39784d181', 'volume_size': 1} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310071503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c517cd11-866c-49eb-bc4c-ebf39784d181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:44:58Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Creating volume c517cd11-866c-49eb-bc4c-ebf39784d181 {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:44:58 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:58 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 1073741824 Sep 30 10:44:58 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:58 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 1073741824" returned: 0 in 0.468s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:58 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:58 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 Sep 30 10:44:58 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:59 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181" returned: 0 in 0.251s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b783f4-fa3d-4f86-908d-0018e561867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c517cd11-866c-49eb-bc4c-ebf39784d181', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2ba997-4d35-48cb-afce-54c8568ded4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:44:59 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Volume volume-c517cd11-866c-49eb-bc4c-ebf39784d181 (c517cd11-866c-49eb-bc4c-ebf39784d181): created successfully Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2ba997-4d35-48cb-afce-54c8568ded4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (08edf4e0-01ca-4037-a7fb-378757932477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:44:59 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-a5c963c4-6d0e-4efc-9915-4276151b4161 tempest-ProjectMemberTests-552928223 None] Created volume successfully. Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Creating offline snapshot c8e2d01c-dc10-43ca-9583-a24ddd014c4a of volume c517cd11-866c-49eb-bc4c-ebf39784d181 {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c6542d-45d6-4542-a477-d0eda162ed22]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:59 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 Sep 30 10:44:59 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:44:59 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181" returned: 0 in 0.371s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:44:59 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:44:59 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a 1G Sep 30 10:44:59 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:00 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a 1G" returned: 0 in 0.396s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c517cd11-866c-49eb-bc4c-ebf39784d181 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:00 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c517cd11-866c-49eb-bc4c-ebf39784d181 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a Sep 30 10:45:00 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:00 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c517cd11-866c-49eb-bc4c-ebf39784d181 -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a" returned: 0 in 0.374s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:00 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a is being set with open permissions: ugo+rw Sep 30 10:45:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:00 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a Sep 30 10:45:00 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:00 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a" returned: 0 in 0.246s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:00 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:00 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.info Sep 30 10:45:00 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:01 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.info" returned: 0 in 0.268s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:01 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.info is being set with open permissions: ugo+rw Sep 30 10:45:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:01 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.info Sep 30 10:45:01 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:01 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.info" returned: 0 in 0.322s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:01 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:45:01 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-f2ee6f75-f507-43bf-8f55-36d198b3efaf tempest-ProjectMemberTests-552928223 None] Create snapshot completed successfully Sep 30 10:45:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-c8e2d01c-dc10-43ca-9583-a24ddd014c4a-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:45:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Lock "cinder-c8e2d01c-dc10-43ca-9583-a24ddd014c4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:45:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-c517cd11-866c-49eb-bc4c-ebf39784d181" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:45:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-c517cd11-866c-49eb-bc4c-ebf39784d181" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:45:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-c8e2d01c-dc10-43ca-9583-a24ddd014c4a" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:45:02 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-c8e2d01c-dc10-43ca-9583-a24ddd014c4a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:45:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Deleting offline snapshot c8e2d01c-dc10-43ca-9583-a24ddd014c4a of volume c517cd11-866c-49eb-bc4c-ebf39784d181 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:45:02 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] snapshot_file for this snap is: volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:45:02 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e59cc0-ae1f-4a06-902b-309ddebedb06]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:45:02 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:02 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a Sep 30 10:45:02 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:03 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a" returned: 0 in 0.361s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:03 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c517cd11-866c-49eb-bc4c-ebf39784d181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:45:03 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5a4ac9-225d-417a-8a34-f4822164ed3c]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:45:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:03 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 Sep 30 10:45:03 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:03 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181" returned: 0 in 0.373s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:03 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a Sep 30 10:45:03 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:03 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a" returned: 0 in 0.358s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:03 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:03 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a Sep 30 10:45:03 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:04 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181.c8e2d01c-dc10-43ca-9583-a24ddd014c4a" returned: 0 in 0.250s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-c8e2d01c-dc10-43ca-9583-a24ddd014c4a" released by "_delete_snapshot" :: held 1.468s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-c517cd11-866c-49eb-bc4c-ebf39784d181" released by "delete_snapshot" :: held 1.503s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Created reservations ['b1c5332c-febd-4100-b959-a79bd0dd3ebb', '35c4b350-5e97-4a02-b547-ec1dda37f161', 'b419b16e-dce8-4be1-b1d8-5c92bdd8c2f6', '9ca8142e-f2a3-4e13-bdcd-c782edf2ce53'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:45:04 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Delete snapshot completed successfully. Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-86b3db4b-91d7-4def-bdcf-dd38eb26856d tempest-ProjectMemberTests-552928223 None] Lock "cinder-c8e2d01c-dc10-43ca-9583-a24ddd014c4a-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-c517cd11-866c-49eb-bc4c-ebf39784d181-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Lock "cinder-c517cd11-866c-49eb-bc4c-ebf39784d181-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-c517cd11-866c-49eb-bc4c-ebf39784d181" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-c517cd11-866c-49eb-bc4c-ebf39784d181" acquired by "delete_volume" :: waited 0.018s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee49158-2478-40e5-b86e-7e963d64567f]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:45:04 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:05 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 Sep 30 10:45:05 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:05 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181" returned: 0 in 0.387s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:05 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181 Sep 30 10:45:05 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:05 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-c517cd11-866c-49eb-bc4c-ebf39784d181" returned: 0 in 0.284s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-c517cd11-866c-49eb-bc4c-ebf39784d181" released by "delete_volume" :: held 0.754s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Created reservations ['c96e6eb9-496e-474e-a8c1-0523bb3be7f9', '7ee6d0ba-85bc-4265-90dc-71cda3692a87', '12649379-a6a9-4dec-b78f-40c5333e2e45', '60a489c7-1098-41bd-91f7-d1e85529e492'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:45:05 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:05 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:45:05 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:06 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.271s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:45:06 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Deleted volume successfully. Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-58d4be76-514a-4c34-a16c-fff3f5fcdbe5 tempest-ProjectMemberTests-552928223 None] Lock "cinder-c517cd11-866c-49eb-bc4c-ebf39784d181-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (8d33c4a9-77e2-4168-a091-fe9cdd533edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3485f3-c2f1-4ae1-9113-1ac18badec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3485f3-c2f1-4ae1-9113-1ac18badec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-780214185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0771c8b1-5c14-4dc6-98d3-e526e5c9c67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:45:06Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2cbac7-071b-464f-b1ea-4d6d084343e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2cbac7-071b-464f-b1ea-4d6d084343e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fc77d5-2ae8-43e8-bf21-625b2a6b07a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fc77d5-2ae8-43e8-bf21-625b2a6b07a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0771c8b1-5c14-4dc6-98d3-e526e5c9c67d', 'volume_name': 'volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51703d47-0ab5-452d-bef5-f4f3ad05709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51703d47-0ab5-452d-bef5-f4f3ad05709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61a48c3-c231-4880-99be-777dbc62a139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:45:06 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Volume 0771c8b1-5c14-4dc6-98d3-e526e5c9c67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d', 'volume_size': 1} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T08:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-780214185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0771c8b1-5c14-4dc6-98d3-e526e5c9c67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b88e1fbda34304acbfbbc8aa1e75c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T08:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T08:45:06Z,use_quota=True,user_id='be777802d48644e281e4bf2b9570f9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848bd20-3875-47af-8834-590d2b4a536a),volume_type_id=9848bd20-3875-47af-8834-590d2b4a536a)}" {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Creating volume 0771c8b1-5c14-4dc6-98d3-e526e5c9c67d {{(pid=87013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Selected osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb as target Quobyte volume. {{(pid=87013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 10:45:06 devstack cinder-volume[87013]: INFO cinder.volume.drivers.remotefs [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] casted to osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb Sep 30 10:45:06 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d 1073741824 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:06 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d 1073741824 Sep 30 10:45:06 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:07 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d 1073741824" returned: 0 in 0.481s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:07 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d Sep 30 10:45:07 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:07 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" returned: 0 in 0.282s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:07 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'} {{(pid=87013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 10:45:07 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:45:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61a48c3-c231-4880-99be-777dbc62a139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d', 'volume_size': 1}' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:45:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a697da5f-c403-4ccc-803e-86996f4a35b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 10:45:07 devstack cinder-volume[87013]: INFO cinder.volume.flows.manager.create_volume [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Volume volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d (0771c8b1-5c14-4dc6-98d3-e526e5c9c67d): created successfully Sep 30 10:45:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a697da5f-c403-4ccc-803e-86996f4a35b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 10:45:07 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Flow 'volume_create_manager' (8d33c4a9-77e2-4168-a091-fe9cdd533edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 10:45:07 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-8ad1d97e-4456-434a-8a7e-beab158613a9 tempest-ProjectMemberTests-552928223 None] Created volume successfully. Sep 30 10:45:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:45:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:45:08 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Creating offline snapshot 592d5d58-f8f0-47a2-9f37-d196b5aab065 of volume 0771c8b1-5c14-4dc6-98d3-e526e5c9c67d {{(pid=87013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 10:45:08 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d111e4d1-ac89-4462-b3f3-d46e4c4505ba]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:45:08 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:08 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d Sep 30 10:45:08 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:09 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" returned: 0 in 0.350s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 1G {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:09 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 1G Sep 30 10:45:09 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:09 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 1G" returned: 0 in 0.390s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:09 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 Sep 30 10:45:09 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:09 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d -F qcow2 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065" returned: 0 in 0.299s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:09 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 is being set with open permissions: ugo+rw Sep 30 10:45:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:09 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 Sep 30 10:45:09 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:09 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065" returned: 0 in 0.234s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:09 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:09 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.info Sep 30 10:45:09 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:10 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.info" returned: 0 in 0.243s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:10 devstack cinder-volume[87013]: WARNING cinder.volume.drivers.remotefs [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.info is being set with open permissions: ugo+rw Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.info {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:10 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.info Sep 30 10:45:10 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:10 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.info" returned: 0 in 0.260s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:45:10 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-e2dce383-be51-46d4-963e-5dfed3aef3f5 tempest-ProjectMemberTests-552928223 None] Create snapshot completed successfully Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-592d5d58-f8f0-47a2-9f37-d196b5aab065-delete_snapshot" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Lock "cinder-592d5d58-f8f0-47a2-9f37-d196b5aab065-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" by "delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-592d5d58-f8f0-47a2-9f37-d196b5aab065" by "_delete_snapshot" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-592d5d58-f8f0-47a2-9f37-d196b5aab065" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Deleting offline snapshot 592d5d58-f8f0-47a2-9f37-d196b5aab065 of volume 0771c8b1-5c14-4dc6-98d3-e526e5c9c67d {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] snapshot_file for this snap is: volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 {{(pid=87013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e021c652-9e92-42e5-baa8-3340e65f25f3]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:45:10 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:11 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 Sep 30 10:45:11 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:11 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065" returned: 0 in 0.348s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:11 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.remotefs [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 10:45:11 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f2e729-8714-4493-9fe6-b6d8e7273164]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:45:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:11 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d Sep 30 10:45:11 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:11 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" returned: 0 in 0.353s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:11 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 Sep 30 10:45:11 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:11 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065" returned: 0 in 0.317s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:11 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:12 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065 Sep 30 10:45:12 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:12 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:12 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d.592d5d58-f8f0-47a2-9f37-d196b5aab065" returned: 0 in 0.241s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-592d5d58-f8f0-47a2-9f37-d196b5aab065" released by "_delete_snapshot" :: held 1.358s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:45:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" released by "delete_snapshot" :: held 1.384s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:45:12 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Created reservations ['330102c4-657d-42c5-9f11-a4ea361fcde2', 'a0de7dd4-21d4-4a8e-9c36-b2d568028018', 'de84efb7-cc44-465d-bc91-135244811689', 'd619e755-1789-4022-a2f9-eb4fa4bc92c6'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:45:12 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Delete snapshot completed successfully. Sep 30 10:45:12 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-bbf594e3-c642-435a-b543-6d4ec975401d tempest-ProjectMemberTests-552928223 None] Lock "cinder-592d5d58-f8f0-47a2-9f37-d196b5aab065-delete_snapshot" released by "delete_snapshot" :: held 1.530s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d-delete_volume" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Lock "cinder-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Acquiring lock "cinder-quobyte-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" by "delete_volume" {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" acquired by "delete_volume" :: waited 0.014s {{(pid=87013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5858fd3-875e-4bdb-91dc-fc0166fa23ac]: (4, 'qcow2') {{(pid=88165) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:13 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d Sep 30 10:45:13 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:13 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" returned: 0 in 0.345s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:13 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d Sep 30 10:45:13 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:13 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a/volume-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" returned: 0 in 0.246s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Lock "cinder-quobyte-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d" released by "delete_volume" :: held 0.646s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG cinder.quota [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Created reservations ['33e81f06-ea34-4b3d-a9a4-f8f36a1b252c', '452aa9c0-fdc4-4ba5-93c8-b09dd88c7a63', '1a05d6c1-3c9d-499d-aced-3d3b2f7e0a63', 'd0b51b9c-19d8-4376-9a8c-c9ab22f16857'] {{(pid=87013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:45:13 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:13 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:45:13 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:14 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:14 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.236s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:14 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:45:14 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Deleted volume successfully. Sep 30 10:45:14 devstack cinder-volume[87013]: DEBUG cinder.coordination [None req-81f84ac8-4604-4380-96e1-f981d896250b tempest-ProjectMemberTests-552928223 None] Lock "cinder-0771c8b1-5c14-4dc6-98d3-e526e5c9c67d-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 10:45:23 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=95,cinder:SELECT=70,cinder:DELETE=11,cinder:INSERT=26 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:45:24 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:UPDATE=101,cinder:SELECT=85,cinder:INSERT=28,cinder:DELETE=5 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb': None} {{(pid=87013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fe37599-6783-42f0-adfa-bbb9313eccdb'] {{(pid=87013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 10:45:37 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a Sep 30 10:45:37 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 10:45:37 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG oslo_concurrency.processutils [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33094ec31fcfdd0cfbb64305eafeaa0a" returned: 0 in 0.248s {{(pid=87013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG cinder.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Notifying Schedulers of capabilities ... {{(pid=87013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG oslo_service.periodic_task [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] Running periodic task VolumeManager._thread_info {{(pid=87013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread count: 29 {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 10:45:37 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-1ea4d97f-694c-4495-ba74-fc4628276ac0 None None] thread info: [<_MainThread(MainThread, started 130638436249728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}